West V; 

(AW department of 

EDUCATION 
STATE SYSTEMIC 
IMPROVEMENT PLAN (SSIP) 


Phase Ill 


—— 


WEsT VirGINIA BOARD OF EDUCATION 
2016-2017 


Thomas W. Campbell, President 
Harold C. Hatfield, Vice President 


Jeffrey D. Flanagan, Member 
Miller L. Hall, Member 
David G. Perry, Member 
FE. Scott Rotruck, Member 
Frank S. Vitale, Member 
Barbara S. Whitecotton, Member 
James S. Wilson, Member 


Paul L. Hill, Ex Officio 
Chancellor 
West Virginia Higher Education Policy Commission 


Sarah Armstrong Tucker, Ex Officio 
Chancellor 
West Virginia Council for Community and Technical College Education 


Steven L. Paine, Ex Officio 
State Superintendent of Schools 
West Virginia Department of Education 


Phase Ill Component A: Summary of Phase III 


A. (1) Theory of Action or logic model for the SSIP including the SiMR. 
Please refer to WV GRADUATION 20/20 Logic Model. (Appendix A) 


A.(2) The coherent improvement strategies or principle activities 
employed during the year, including infrastructure improvement 
strategies. 


Please refer to YEARS 1-2 Dropout Prevention Intervention Framework and YEARS 2-3 
CEEDAR Transition Practices Framework and Improvements to State Infrastructure Charts. 
(Appendix B) 


The Dropout Prevention Intervention Framework and CEEDAR Transition Practices Framework 
Charts outline the specific activities needed to implement the coherent improvement strategies. 
The WV GRADUATION 20/20 initiative was implemented during the 2015-2016 academic year 
beginning with sixty-nine (69) schools in thirty-six (36) counties representing fifty-nine (59) 
percent of West Virginia’s high schools. During the 2016-2017 academic year the number of 
high schools has grown to seventy-two (72) and the cohort now includes twenty (20) middle 
schools bringing the total to ninety-two (92) schools in forty-one (41) counties. Due to the 
increase of participating schools both the original cohort and additional self-referred schools 
are at different stages of implementation within both frameworks. 


The Improvements to State Infrastructure Chart provides an update to the Phase II Chart 
reflecting activities completed and a Phase III Chart reflecting activities initiated in 2016-2017. 
(Appendix C) 


A.(3) The specific evidence-based practices that have been 
implemented to date. 


Please refer to the Years 1-2 Dropout Prevention Intervention Framework and Years 2-3 
CEEDAR Transition Practices Framework Charts under the Implement Improvement Strategies 
and EBPs. These charts depict the evidence-based practices implemented to date. 

(Appendix B) 


A.(4) Brief overview of the year’s evaluation activities, measures 
and outcomes. 


Evaluation efforts during the 2016-2017 school year have, with some adjustments, followed the 
Evaluation Plan submitted for Phase II (see WV GRADUATION 20/20 Evaluation Measurement 
Table: 2015-2016, Appendix D). Informed by stakeholder input, there were two (2) key changes 
to the evaluation (see WV GRADUATION 20/20 Evaluation Measurement Table: School Year 
2016-2017, Appendix E). First, beyond conducting focus groups with School Leadership 
Teams, the Regional School Support Specialists (RS%s) also participated in a focus group. This 
addition of qualitative data enriched the SEA’s ability to provide meaningful and actionable 
improvements to the initiative support and delivery services. Second, the evaluator worked 
closely with the RS®s to revise the WV GRADUATION 20/20 Reflection Rubric to ensure 

that it a) was a useful fidelity measurement tool, b) applied to all schools regardless if they 
were new to the initiative or well established, and c) reduced the burden of reporting. Once 
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a pre/post survey conducted twice a year, the rubric is now a retrospective pre/post survey 
conducted once a year. Further, some of the participating schools are in the first year of 
implementation (using the Dropout Prevention Intervention Framework) while other schools are 
in the second year of implementation (using the CEEDAR Transition Practices Framework). 

In recognition of this, the rubric was revised to capture the key steps and activities of both 
frameworks; eliminating the need for multiple tools over multiple implementation years (see 
WV GRADUATION 20/20 Reflection Rubric, Appendix F). Additionally, RS#s will complete a 
rubric for each of the schools they support. Initially only the school teams were to complete the 
rubric, with their RS* reviewing the results with them. However, this strategy will allow the RS°s 
and their schools to better see and understand the stages of implementation, areas of strength, 
and areas where additional support is needed. 


All other areas of the Evaluation Plan have been carried out as planned. To date, evaluation 
efforts, measures, and outcomes are on schedule. Please refer to the WV GRADUATION 
20/20 Evaluation Measurement Table: School Year 2016-2017, Appendix E. The WVDE 
structure of an in-house evaluator alleviates budgetary, data access, and capacity constraints 
that may be present when using outside evaluators.. Further, the SEA is well positioned to 
reach its SIMR (81.44% of youth with IEPs graduating from high school with a regular diploma 
by 2017-2018). The graduation rate for students with disabilities in 2015-2016 was 76.58%, an 
increase of 7.45 percentage points over the 2014-2015 rate of 69.13%. 


A.(5) Highlights of changes to the implementation and improvement 
strategies. 


The SEA has continued to make changes to the implementation and improvement strategies 
submitted for Phase | and II: 


IMPLEMENTATION STRATEGIES 


e Increased number of high schools in cohort from 69 to 72. 
e Included 20 middle schools in cohort. 
e Increased the number of years schools are part of the cohort from two (2) to five (5). 


e Revised the WV GRADUATION 20/20 Timeline/Benchmarks for implementation of 
the framework to more adequately reflect school progress. Please refer to the WV 
GRADUATION 20/20 Timeline/Benchmarks (Appendix G). 


e Provided financial support to schools of $2,500.00 from two (2) to five (5) years. 


e Quarterly meetings of the interagency West Virginia Partners in Transition Team (WVPTT) 
evolved into the membership of the National Technical Assistance Center on Transition’s 
(NTACT) West Virginia Intensive State Team. Representatives on the team include SEA, 
RESA, DRS, IHE and PTI. 


e Quarterly meetings of the intra-agency West Virginia Partners in Graduation Team 
(WVPGT) evolved into WVDE monthly Cross Division Meetings consisting of 
representatives from the Divisions of Teaching and Learning, Career Technical Education, 
and Accountability and School Effectiveness. 


IMPROVEMENT STRATEGIES 


Review, revise, and sign Memorandum of Understanding between the West Virginia 
Department of Education and West Virginia Division of Rehabilitation Services. 


Secure Memorandums of Understanding between Local Education Agencies and West 
Virginia Division of Rehabilitation. 


Revise Policy 2419: Regulations for the Education of Students with Exceptionalities to 
include: 


> Division of Rehabilitation as provider 
> Pre-employment Transition Services included on the Summary of Performance 


> Pre-employment Transition Services (Pre-ETS) added to transition section in 
Individualized Education Program (IEP) 


Developed with DRS “Planning for the Future” brochure which provides information to 
parents’ of students with disabilities on transition. 


Developed with DRS “Transition Services Planner” booklet which provides a tool for 
schools and Division of Rehabilitation staff to utilize when planning for students. 


Developed with DRS “West Virginia Transition Services Guide” document which captures 
Pre-employment Transition Services provided between 8" grade and post-secondary 
training. 


Provided to LEAs revised One Year Follow-Up Survey Reports and Exit Survey Reports for 
the LEA and schools within the LEA. 


Revised Community Readiness book. 


Revised with the Office of Career and Technical Education the Individual Work Readiness 
Competencies (IWRC) which provides guidance on CTE alternative programming for 
students with disabilities. 


Sponsored in the summers of 2015-2016 and 2016-2017 training for WV GRADUATION 
20/20 schools at the West Virginia Department of Education sponsored KidStrong 
Conference. Topics included Transition and the Diploma Minded Principal. 


Partnered with the Office of Research, Data Governance, and Accountability to provide 
intensive training in the WV GRADUATION 20/20 schools in the use of ZoomWV and 
ZoomWV-e. 


Conducted twelve (12) face-to-face meetings with Regional School Support Specialists 
(RS°) which included specific training and sharing. 


e Assigned to eight (8) Regional School Support Specialists evidence-based practices within 
the National Dropout Prevention Intervention Framework to develop in one (1) or more of 
their assigned schools: 


oO 


[e) 


RESA 1 Employ Coach Approach 


RESA 2 Use cooperatively Transition Services Planner with Division of Rehabilitation 
Services staff 


RESA 3 Implement Check and Connect 
RESA 4 Expand Student Led IEPs 


RESA 5 Participate in Transition Coalition self-study, Building a Transition 
Assessment Tool Kit 


RESA 6 Engage Feeder Middle Schools in Transition Activities 
RESA 7 Increase Use of One Year Out Follow-Up Survey Data 
RESA 8 Expand Family Involvement in Transition 


Phase Ill Component B: Progress in Implementing the SSIP 
B.(1) Description of the State’s SSIP implementation progress. 


a. Description of extent to which the State has carried out its 


planned activities with fidelity. 


b. Intended outputs that have been accomplished as a result of 


the implementation activities. 


Outlined in the WV GRADUATION 20/20 Memorandum of Understanding (MOU) are the expectations 
of all parties involved in the initiative. The table below represents the implementation progress and 
the extent to which the State has carried out its planned activities with fidelity. This is also represented 
in the WV GRADUATION 20/20 Logic Model in the outputs column. 


IMPLEMENTATION ACTIVITIES Rees ane 


Provide ongoing technical assistance to include, but not limited to, listserv, 
print resources and materials, assistance with the development of dropout 
prevention and transition initiatives, assistance with reviewing and analyzing SY 
data relevant to school retention and predictors of positive post school 
outcomes, and capacity building forums. 


Provide six days of professional learning in years one and two. Y 


Set aside financial resources to support substitutes, travel, and stipends. 


Assist with the utilization of the Online Data Collection system to measure and 
monitor progress on the WV GRADUATION 20/20 initiative including: 


a. lead collaborative conversations quarterly Y 
b. monitor and make recommendations for adjustments as 
needed 
Review progress annually and develop an annual report submitted to USDE’s 
Office of Special Education Programs (OSEP). Y 


B. (2) Stakeholder involvement in SSIP implementation. 


a. How stakeholders have been informed of the ongoing 
implementation of the SSIP. 


b. How stakeholders have had a voice and been involved in 
decision making regarding the ongoing implementation of the 
SSIP. 


Stakeholder Involvement 


The Office of Special Education (OSE) engaged with stakeholder groups to collect input on 
implementation strategies and evaluations. OSE sought the input of educators, parents, West Virginia 
Department of Education (WVDE) staff and other State Agencies. Due to budget constraints in West 
Virginia the WVDE placed restrictions on meetings held and travel. OSE staff traveled to meetings in 
Charlotte, NC, Dallas, TX, Weston, Beckley, Logan, Flatwoods, Clarksburg, Charleston, Morgantown, 
Fairmont, Roanoke, Huntington, Summersville, Martinsburg, Wheeling and Parkersburg, WV which 
will result in 115 meetings where information on West Virginia GRADUATION 20/20 was presented 
and input sought. Stakeholders present at these meetings comprised various roles: parents of 
students with disabilities, general education administrators, general education teachers, special 
education administrators, special education teachers, US Office of Special Education Programs 
(OSEP) Technical Assistance Centers, outside agency providers, and representatives from institutions 
of higher education. In addition to these stakeholders OSE also gathered input from the Special 
Education Advisory Panel, local special education directors, RESA personnel, the internal WVDE WV 
GRADUATION 20/20 State Leadership Team and the Division of Teaching and Learning Offices of 
Assessment, Middle/Secondary Learning, and Early Learning. 


The Regional School Support Specialist (RS*) held monthly meetings during 2016-2017. These 
meetings provided a forum for the eight RS*s to discuss common barriers, successes, and make 
suggestions for changes to ongoing implementation of WV GRADUATION 20/20. 


09/15/16 — 09/16/16, 
West Virginia Advisory Council For The Education of 01/17/17 — 01/18/17, 
Exceptional Children 12/08/16 — 12/09/16, 
03/16/17 — 03/17/17 


08/18/16 — 08/19/16, 04/06/17, 


National Technical Assistance Center for Transition 05/02/16 — 05/06/16, 05/16/17 — 
05/18/17 

IDEA Data Center Interactive Institutes 06/01/16 — 06/02/16 
National Center for Systemic Improvement Cross-State 
Collaborative 11/30/16 - 12/02/16 
Co-Teaching/WV GRADUATION 20/20 02/14/17 - 02/16/17 

: 07/27/16 - 07/28/16, 07/25/17 — 
Student Success Summit 07/26/17 
WV GRADUATION 20/20 Academy/Professional Learning 06/21/16 — 06/24/16, 06/21/17 — 
Institute KidStrong 06/23/17 


01/18/16, 03/21/16, 05/16/16, 
07/18/16, 09/19/16, 11/21/16, 
02/27/17, 03/20,17, 05/15/17, 
07/17/17, 09/18/17, 11/20/17 


Expanded School Mental Health 


Transition Fair (DRS) 10/20/16, 03/23/17 
WV School Psychologists’ Conference 10/24/16 — 10/25/16 
WV Council for Exceptional Children 11/03/16 
08/12/16, 08/31/16, 10/08/16, 
IDEA Data Center 03/09/17, 03/24/17, 03/27/17, 
03/28/17 


Council of Administrators of Special Education/Special 10/12/16 - 10/14/16, 03/02/17 — 
Education Administrative Conference 03/03/17 


09/01/16, 10/06/16, 12/01/16, 


Intra-agency West Virginia Partners in WV GRADUATION 01/05/16 02/02/17. 03/02/17 
20/20 Team Cross Division Meetings 04/06/17, 05/04/17 
11/03/16, 12/01/16, 01/05/17, 
Office of Special Education Staff Meetings 02/02/17, 06/02/16, 08/11/16, 
09/15/16, 10/20/16 
Parent Education Resource Center (PERC) Conference 06/21/16 — 06/23/16 


07/15/16, 08/30/16, 09/22/16, 
10/18/16, 10/22/16, 11/15/16, 
Regional School Support Specialists (RS*) Monthly Meetings | 12/06/16, 01/03/17, 02/07/17, 
03/02/17, 03/03/17, 04/12/17, 
05/17/17, 06/06/17 


Developmental Disabilities Meeting 10/03/16, 01/24/17 
Traumatic Brain Injury Meeting 11/16/16 
Pathways-Conversations on the Porch (PRS) 07/21/16 — 07/22/16 
New Teacher Bootcamp 08/26/16 — 08/28/16 
Graduation School Recognition 02/10/17 

West Virginia Board of Education Presentation 08/10/16 


West Virginia Division of Rehabilitation Services Conference | 08/23/16 


Phase Ill Component C: Data on Implementation and 
Outcomes 


C.(1) How the State monitored and measured outputs to assess 
the effectiveness of the implementation plan. 


a. How evaluation measures align with the theory of action. 


Described in Phase II, and depicted below in a continuous improvement cycle, there is 
a progressive relationship between the major components of the WV GRADUATION 
20/20 initiative. Once graduation was chosen for the SSIP, the WVDE leveraged existing 
relationships with the National Dropout Prevention Center for Students with Disabilities’ 
(NDPC-SD) and the Collaboration for Effective Educator, Development, Accountability, 
and Reform (CEEDAR) Center to utilize their evidence based frameworks, the Dropout 
Prevention Intervention Framework (DPIF) and the Transition Practices and Predictors 
framework. 


These EBP frameworks informed the theory of action, and provided the foundation for 
the implementation manual and timeline/benchmarks. Further, the timeline/benchmarks 
informed the logic model and evaluation questions. The evaluation questions were the 
basis of the measurement table. Results from the evaluation activities carried out in the 
measurement table will be used to further improve implementation of the EBPs chosen 
for the WV GRADUATION 20/20 initiative. 


Prevention Intervention 
& CEEDAR Transition 
Practices Framework 


WV GRADUATION 20/20 
Evaluation results 


WV GRADUATION 20/20 


Measurement Table 


WV GRADUATION 20/20 


WV GRADUATION 20/20 
Theory of Action 


WY GRADUATION 20/20 
Implementation Manual 


WY GRADUATION 20/20 


Evaluation Questions Timeline/Benchmarks 


WV GRADUATION 20/20 
Logic Model 


b. Data sources for each key measure. 


Please refer to the WV GRADUATION 20/20 Evaluation Measurement Table: School 
Year 2016-2017 for a full list of performance indicators, measures, collection schedule, 
and current status. (Appendix E) 


Services and products created and delivered PD provided 
by the WVDE and the RESAs to support TA ided 
implementation of WV GRADUATION 20/20 PrOvice 


Resources provided 


Document review 


Focus group 


RESAs providing ongoing collaboration, support, | RS* monthly reports 
and technical assistance to schools as they 
implement WV GRADUATION 20/20 


Completed school documents 
(MOUs, contact list, action plans, 
meeting agendas) 


Completed Core Data Tool 


Completed Transition Practices and 
Predictors framework 


Focus groups 


Implementation of the Dropout Prevention WV GRADUATION 20/20 Reflection 

Intervention Framework (DPIF) with fidelity Rubric 

Implementation of the Transition Practices and | WV GRADUATION 20/20 Reflection 

Predictors Framework with fidelity Rubric 

Improved outcomes, specifically graduation State graduation rate, 4-year cohort 

rates, among students with disabilities standard diploma, among students 
with disabilities 


c. Description of baseline data for key measures 


Base line for West Virginia’s SiMR is the graduation rate for students with disabilities 
prior to initiative implementation, 67.08% for school year 2013-2014. While not part of 
the formal evaluation, RS’s and schools track baseline and longitudinal data using tools 
such as the Core Data Tool and the School Action Plan. 


d. Data collection procedures and associated timelines. 


Please refer to the WV GRADUATION 20/20 Evaluation Measurement Table: School 
Year 2016-2017. (Appendix E) 


e. (If appropriate) sampling procedures 


There were no sampling procedures used in this evaluation. 


f. (If appropriate) planned data comparisons 


Two data comparisons are part of the evaluation plan. First, state level graduation 
rates among students with disabilities will be monitored annually across the span of the 
initiative. Second, results of the Reflection Rubric will be examined, aggregated, and 
reported each year. Further, individual rubric results will be available to the RS%s and 
the schools they support. These data will allow RS°s and participating schools to better 
see and understand the stages of implementation, areas of strength, and areas where 
additional support is needed. 


g. How data management and data analysis procedures allow for 
assessment of progress toward achieving intended improvements 


The evaluator works closely with the Office of Special Education and is a member of the 
SEA WV GRADUATION 20/20 Leadership Team. The logic model, evaluation questions, 
and measurement table were developed with input from multiple stakeholder groups. 


Of note, the SEA Leadership Team and RESA staff (including the RS%s) were pivotal in 
the development of the evaluation and evaluation tools. Using the WV GRADUATION 
20/20 Implementation Manual as the foundation, we developed a protocol wherein the 
RS's submit monthly reports, School Leadership documents, and School Action Plans 
to a coordinator in OSE. Together, the evaluator and OSE coordinator developed a 
check-list to track and monitor process documents. Further, with input from the RS°s, 
the evaluator created and/or modified templates and examples of the Core Data Tool, 
School Action Plan, and Reflection Rubric to optimize the usefulness of the tools. 


The evaluation calls for a mixture of quantitative and qualitative data collection. The 
Reflection Rubric is an online tool; once data collection is completed the results will be 
analyzed to create both aggregate data (to be made available to all) as well as school 
specific data (shared with the appropriate RS° and their schools). We believe the 
Reflection Rubric will be a reliable and valid tool because the items are framed within 
the stages of implementation from implementation science. Additionally, the foundation 
of the rubric was shadowed, with permission, after an implementation rubric that proved 
to be a valid measurement tool in another evaluation conducted by the WVDE’s Office 
of Research, Accountability, and Data Governance. 


The focus groups were conducted by the initiative’s evaluator. The structured questions 
used in the focus groups were developed by the evaluator and peer reviewed; questions 
were made available in printed format to focus group participants during the focus 
group. Participants were informed of their rights, that they could stop participation 

at any time, and were asked to provide verbal permission for recording the session. 
Recorded results were transcribed and analyzed for themes. They were recorded, 
transcribed, and then analyzed for themes. Results will be published on the WVDE 
website. Outcome data, specifically graduation rates, are drawn from the SEA data 
system (WVEIS) and put into visual presentations by the evaluator. The evaluator, with 
close to ten (10) years of experience in evaluation and statistical analysis, is responsible 
for the management and analysis of these data. 
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- Implementation Manual - SEA - Document 
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; - Document 
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agenda/minutes) Coordinator 
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| - Focus groups 


/- RS? Monthly Report - School - Document 
[ hi 
|- Core Data Tool =a P pea 
| Action PI - Tool revisions 
~ School Action Plan - RS3s per stakeholder 
- Transition Practice Profile - OSE input 
~ Reflection Rubric Coordinator - Aggregated data 
- Focus groups - Evaluator 
|- WVEIS (WV Education - Evaluator - Aggregated 
Information System), state level data 
ZOOM-WV 


C.(2) How the State has demonstrated progress and made 
modifications to the SSIP as necessary. 


a. How the State has reviewed key data that provide evidence 
regarding progress toward achieving intended improvements to 
infrastructure and the SiIMR. 


Review of key data in the progress toward achieving WV’s SiMR includes examination 
of longitudinal graduation rate data at the state, RESA, county, and school levels. 

The table 4-Year Adjusted Cohort Graduation Rates by RESA: 2012-2016 indicates 
improvements to the graduation rates among all students as well as students with 
disabilities (SWD). Further, the graduation rate gap is closing between the two groups; 
decreasing by 6.2 percentage points over the span of five (5) years. 


4-Year Adjusted Cohort Graduation Rates by RESA: 2012 - 2016 
All SWD 
RESA County 2012 2013 2014 2015 2016 2012 2013 2014 2015 2016 
Mercer 
Monroe 
McDowell 
Raleigh 
Summers 
Wyoming 
Cabell 
Lincoln 
Logan 
Mason 
Mingo 
Wayne 
Boone 
Clay 
Kanawha 
Putnam 
Braxton 
Fayette 
Greenbrier 
Nicholas 
Pocahontas 
Webster 
Calhoun 
Jackson 
Pleasants 
Ritchie 
Roane 
Tyler 
Wirt 
Wood 
Brooke 
Hancock 
Marshall 
Ohio 
Wetzel 
Barbour 
Doddridge 
Gilmer 
Harrison 
Lewis 
Marion 
Monongalia 
Preston 
Randolph 
Taylor 
Tucker 
Upshur 
Berkeley 
Grant 
Hampshire 
Hardy 
Jefferson 
Mineral 
Morgan 
Pendleton 


Graduation rate = 4-year adjusted cohort, standard diploma 
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b. Evidence of change to baseline data for key measures 


Progress toward achieving our SIMR (81.44% of youth with IEPs graduating from high 
school with a regular diploma by 2017-2018) is visible when looking at longitudinal 
graduation rates. Rates among students with disabilities are increasing and the gap 
between rates for the All group and the students with disabilities (SWD) group is 
shrinking. See graph below. 


WV Graduation Rates: 2012 - 2016 


<BAll <@SwWD 


90 84.46 86.93 


79.32 Graduation gap M 
= 13.2% v 


4 Graduation gap 


| =19.4% 76.58 


59.91 62.09 


Graduation rate (%) 


2012 2013 2014 2015 2016 


Graduation rate = 4 year adjusted cohort, standard diploma. 
Graduation gap % = difference in percentage points, not percent change. 


c. How data support changes that have been made to 
implementation and improvement strategies. 


During the 2014-2015 pilot year data supported significant changes to the 
implementation as well as various improvement strategies. The WV GRADUATION 
20/20 Implementation Manual was developed along with monitor and tracking tools in 
the form of RS* Logs, Contact Lists, Agenda/Minutes, Core Data Tool, and Action Plans. 


A review of monthly logs provided by the RS*s demonstrated that the initiative is gaining 
momentum therefore, no changes will be made at this time. During 2016-2017 it was 
not necessary to make changes. 
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d. How data are informing next steps in the SSIP implementation. 


Reports such as the Exit Survey Report and One-Year Follow-up Report (Appendix 
H), along with quantitative data from the focus groups are helpful in informing next 
steps in the WV GRADUATION 20/20 initiative. The Exit and One-Year Follow-up 
Survey Reports, produced at the state, county, and school levels, inform WVDE and 
stakeholders about the quality of services provided to students with IEPs, as well as 
student outcomes one year after exiting high school. This correlates with the intent 
of schools to progress from using the Dropout Prevention Intervention Framework to 
implementing the Transition Practices and Predictors Framework. 


Moreover, the use of qualitative data in the form of focus groups assists in the 
continuous improvement cycle of implementing the WV GRADUATION 20/20 initiative. 
In the summer of 2016 three (3) focus groups were conducted; two (2) comprised of 
School Leadership Team Members while the third was with the RS°s. Participants were 
asked to frame their responses within the 2015-2016 school year. See the table below 
for major themes discovered when the evaluator analyzed the transcripts from the focus 
groups. 


GRADUATION 20/20 School Leadership Teams seemed relatively well established 
according to those participating in the focus groups 


Participating team members are not overly familiar with implementation manual and the 
formal names of the EBP frameworks (Dropout Prevention Intervention Framework and 
Transition Practices and Predictors Framework) 


o However, the work they are doing follows the steps in the frameworks 


Expressed high praise for graduation coaches, saying they make a notable difference in 
dropout rates 


o Schools, districts, and RESAs need additional funding to hire and/or retain 
graduation coaches 


Use webinars and other archived resources on the WV GRADUATION 20/20 website 


Positive experiences leveraging resources from Innovation Zone grants, Optional 
Pathways, CTE programs, Devision of Rehabilitation Services, and DHHR 


Most participants stated they had positive experiences and interactions with their RS? 


Some participants found tools such as the Core Data Tool and the School Action Plan to 
be useful while others found them to be labor intensive 


o Team members did use the samples provided 


Participants discussed the importance of working with their feeder middle schools in 
dropout prevention interventions 


Some schools experienced difficulty with getting other school staff to buy into the initiative 


Communication break-downs at multiple levels (i.e., RESA, school administration, team 
members, and other school staff) slowed implementation 


Staff turnover at school level made it difficult to maintain momentum as a team 
Losing county or RESA funded graduation coaches was big loss to some schools 


Finding time to work on the initiative was a barrier for some school teams 


Access to data (example: sometimes rolls such as team leader or graduation coach 
would not have access to student level data) 
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Indicate a need for a forum for discussion accessible by all team members in all WV 
GRADUATION 20/20 participating schools 


Suggestions for improvement included access to information and resources using 
multiple formats and medias; more specificity in examples of strategies to use as 
interventions 


WV GRADUATION 20/20 Implementation Manual has become the ‘RS? go to book’ 


Tools and resources (such as the Core Data Tool, School Action Plan template, annual 
schedule of events, webinars, etc.) provided by the SEA are helpful 


RSs appreciate the fast responses to questions/issues when they contact the SEA 


Use the WV GRADUATION 20/20 website and the links to the initiative resources 
frequently when working with school teams 


Found that school teams respond to and appreciate the flexibility the Dropout Prevention 
Intervention Framework offers to suit local needs 


Some RS‘s felt the capacity they were helping build at their schools impacted more than 
just the School Leadership Team; it was improving overall school climate 


RS°s became “data” ambassadors; training their school teams in the use of the state’s 
data reporting tools: ZOOMWV, ZOOMWYV-e, and the WV Early Warning System 
(developed by Bright Bytes) 


RSs connect the bridges between schools, RESAs, and the SEA; due to steady support 
(i.e. site visits) schools are realizing this initiative has legitimacy and longevity; schools 
are comfortable contacting their RS? for multiple types of assistance 


RS?s informally developed their own PLC to share resources, ideas, and experiences; 
were happy when SEA could join monthly RS? meetings 


Have seen success in schools who used a coaching approach, as well as schools who 
had an Innovation Zone grant 


Communication break-downs at multiple levels, such as: the roll-out of the initiative and 
whether schools could opt-out or not; and school teams not successful in sharing their 
work, data, and outcomes with the rest of their school 


RS%s reported that school leadership/administrators set the tone, thus schools with 
leadership/administrators in favor of and involved with the initiative were able to adopt and 
implement WV GRADUATION 20/20 faster and with greater ease than schools that did 
not have positive support from leadership/administrators 


An initial barrier was finding the right balance of relationship building, communication, 
level of support, and expectations of work-loads at each school; in a support role, RS%s 
did not have the authority to hold school teams accountable for completing tasks (Such 
as the School Action Plan). The positive involvement and support of school leadership/ 
administration was pivotal in ensuring the work required by the initiative was completed 


Time available to spend at each school; some schools would have benefited from more 
frequent visits than was possible due to the large number of schools participating in WV 
GRADUATION 20/20 


Internet access/speed/reliability an issue at some schools. RS%s cannot rely on ability 
to access internet on-site; can impede access to tools such as ZOOM, Early Warning 
System, and WV GRADUATION 20/20 website 
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Provide forum for schools to share experiences at face-to-face meeting; encourage and/or 
assist schools in the development of PLCs 


Publish school success stories on the WV GRADUATION 20/20 website 


Improve communications between the SEA, RESA, and schools; consider using listserv or 
social media as a method of communication 


Continue to provide TA to the RESAs via monthly meetings, tools, resources, training, etc. 


Continue to understand that different schools are at different stages of implementation; 
allow for the fact that not all schools began working on the initiative at the same time 


Encourage middle schools (especially feeder schools) to join WV GRADUATION 20/20; to 
help with buy-in from high schools as well as with sustainability 


Would like to see more support provided at the school level; that schools who have 
dedicated graduation coaches or other supportive roles have shown more success 


e. How data support planned modifications to intended outcomes 
(including the SiIMR) rationale or justification for the changes or 
how data support that the SSIP is on the right path. 


Data collected to date provides evidence that the SSIP is on the right path. 


e Graduation rates among students with disabilities have been increasing (SiIMR) 
while the graduation rate gap between the all group and students with disabilities 
has decreased 


e The SEA has provided the services and resources outlined in the WV GRADUATION 
20/20 MOU 


e Short term outcomes, as listed in the WV GRADUATION 20/20 Measurement Table, 
have been accomplished 


e Initiative document reviews indicate the SEA, RESAs, RSs, and School Leadership 
Teams are actively engaged in the steps of the EBPs used in WV GRADUATION 
20/20 


e Focus group results from key stakeholders, School Leadership Teams, and RS°s, 
provide positive feedback and thoughtful insights in ways to alleviate barriers and 
improve services 


C. (3) Stakeholder involvement in the SSIP evaluation 


a. How stakeholders have been informed of the ongoing 
evaluation of the SSIP. 
Please refer to the charts in component B. (2): Stakeholder Involvement in SSIP 


Implementation (a and b). This chart outlines how the Office of Special Education 
engaged stakeholder groups while being constrained by state budget restrictions. 


b. How stakeholders have had a voice and been involved in 
decision-making regarding the ongoing evaluation of the SSIP. 
Beyond engaging with stakeholders listed in component B, key input regarding 

the implementation and evaluation of the initiative came from focus groups. At the 


conclusion of the first implementation year (2015-2016 school year), two focus 
groups with School Leadership Team members, and one focus group with the RS°s 
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were conducted. Results of the focus groups are informing improvement to the 
implementation of WV GRADUATION 20/20 at the state, RESA, and school levels. 
Additionally, the results will be published on the WVDE website. See component C.(2) 
for focus group results. 


Phase Ill Component D: Data Quality Issues 


D.(1) Data limitations that affected reports of progress in 
implementing the SSIP and achieving the SIMR due to quality of 
the evaluation data. 


a. Concern or limitations related to the quality or quantity of the 
data used to report progress or results. 


To date, we have discovered few limitations to data for the purposes of evaluating 

the SSIP. Process measures primarily consist of document reviews, check-lists, and 
some qualitative data from focus groups. The quantity and quality of data measuring 
implementation fidelity has not been collected yet. The Reflection Rubric will collect 
implementation fidelity data from School Leadership Teams and RS?s beginning in April 
of 2017; therefore we do not know what barriers exist for these data. However, we are 
addressing data issues related to measuring our SiMR (state level graduation rates). 


Quantity - Two of the State Performance Plan/Annual Performance Report (SPP/APR) 
Indicators #8 and #14 present concerns related to the quantity of data. Results Indicator 
#8 Parent Involvement captures the percent of parents with a child receiving special 
education services who report that school facilitated parent involvement as a means of 
improving services and results for children with disabilities. Question 24, Transition from 
School, probes whether or not the school provides information on agencies that can 
assist a child in the transition from school. School-Age Response Rate was 21% on the 
West Virginia Parent Involvement Survey. During 2016-2017, various methods (online, 
paper copy and face-to-face survey queries) are being used to increase the response 
rate. Results Indicator #14 Post School Outcomes tallies the percent of youth who are 
no longer in secondary school, had IEPs in effect at the time they left school, and what 
post- school activity they are participating in. The SPP/APR FFY 2015 Target was 66% 
and WV’s percent was 65.34%. West Virginia's 2015-2016 One Year Follow-Up Survey 
Response Rate was 58.52%. The Response Rate Target was 60% and there was a 
wide variance among LEAs. LEAs will be evaluated on whether they met the Response 
Rate as a part of their Results Score on their Annual Determination. 


Quality - Internal WVDE procedures and external procedures need to be put into place 
which would improve the data match between WV’s SLDS system, ZoomWYV, and its 
informational system, WVEIS WOW. 


b. Implications for assessing progress or results. 


More responses need to be generated on the Parent Involvement and One Year Follow- 
Up Surveys in order to secure a better representation. When there is a discrepancy 
between those students reported as exiting the school system and those students 
actually exiting, data quality is effected on Indicators 14, 1, and 2. Edit checks are being 
put into place to make sure the end of the year exits are coded properly. 
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c. Plans for improving data quality. 


West Virginia has partnered with the Center for the Integration on IDEA Data (CIID) 
whose mission is to support State Education Agencies (SEAs) with the integration 

of IDEA Part B Sections 616 and 618 data with statewide longitudinal data systems 
(SLDS). The tool, Generate, is designed to automate and simplify EDFacts reporting, 
provide consistency across the SEA for IDEA data reporting, and produce user-friendly 
reports to support data use. Generate has the capability to produce reports that can be 
used to support administration and policy work toward improved educational outcomes 
for children with disabilities and their families. Generate is designed to help increase 
the efficiency of data submissions and improve the quality of IDEA data. West Virginia 
is in collaboration with the IDEA Data Center (IDC) to implement the use of the Data 
Processing Tool Kit. The kit will interface with Generate as well as improve knowledge 
of IDEA data and align our processing of EDFacts with the file specifications. Enhanced 
processing procedures will result in improved data quality and data fidelity. 


Phase Ill Component E: Progress toward Achieving Intended 
Improvements 


E.(1) Assessment of progress toward achieving intended 
improvements. 


a. Infrastructure changes that support SSIP initiatives, including 
how system changes support achievement of the SiMR, 
sustainability and scale-up. 


IMPROVEMENTS TO STATE INFRASTRUCTURE 
PHASE II 2015-2016 


ACHIEVEMENT 
GOVERNANCE OF THE SiMR SUSTAINABILITY | SCALE-UP 


Reorganized OSE staff to support SPP/APR 
Indicators 1-17. v v 


Embedded WV GRADUATION 20/20 responsibilities 
in Office of Special Education (OSE) staff Sf Sf 
assignments. 


Developed and utilized questions relating to 
Year 1 implementation of the Dropout Prevention 
Intervention Framework (DPIF) when the Office SY 
of Federal Programs visits schools in the WV 
GRADUATION 20/20 Cohort 1. 


Convene quarterly meetings of the interagency 
West Virginia Partners in Transition Team (WVPTT) Y 
to increase interagency collaboration at the state, 
regional and local levels. 
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Convene Quarterly meetings of intra-agency West 
Virginia Partners in Graduation Team (WVPGT) to 
collaborate on WVDE activities supporting college, 
career and community readiness initiatives. 


Convene weekly meetings of WV GRADUATION 
20/20 Leadership Team. 


Convene School Leadership Teams led by RESAs. 


Revised Results Driven Accountability Compliance 
Monitoring System Guidelines. 


http://wvde.state.wv.us/osp/spp.html 


Revised Results Driven Accountability General 
Supervision System Guidelines. 


http://wvde.state.wv.us/osp/spp.html 


Employed Research Coordinator/Assigned Evaluator 
of SSIP. 


v 


NEN EN ONNN 


v 


Employed Data Management and Analysis 
Coordinator. 


v 


GOVERNANCE 


Employed CPA as Finance Coordinator. 


ACHIEVEMENT 


OF THE SiMR 


SUSTAINABILITY 


SCALE-UP 


Collaborated with RESA to plan and execute WV 
GRADUATION 20/20. 


v 


Developed Regional School Support Specialist (RS*) 
Job Description, outlining expertise of personnel 
working directly with LEAs to implement WV 
GRADUATION 20/20. 


v 


Developed Memorandums of Understanding 
(MOU) for cohort schools in WV GRADUATION 
20/20 outlining WVDE, RESA, LEA and school 
responsibilities. 


Develop MOU for Institutions of Higher Education 
(IHE) to examine coursework (general, special, 
administrative) through Transition Innovation 
Configurations (IC) from CEEDAR Center. 


\} NEN YN 


Align WV GRADUATION 20/20 process with Every 
Student Succeeds Act (ESSA). 


Revised Policy 2419 Regulations for the Education 
of Exceptional Students to reflect both Compliance 
and Results Focus. 


Partnered with the Office of Student and School 
Support in WV GRADUATION 20/20 initiative. 
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| ACHIEVEMENT 
ACCOUNTABILITY OF THE SimR | SUSTAINABILITY | SCALE-UP 


Revised Policy 2419 Regulations for the Education 
of Exceptional Students and Individualized 
Education Program to reflect Pre-employment Y Y Sf 
Transition Services, Career and Technical Education 
and Division of Rehabilitation Services (DRS). 


Signed MOU with DRS at SEA and LEA levels. SY 


Partnered with the Office of Research, Accountability 
and Data Governance in WV GRADUATION 20/20 Y 
initiative. 

Added Addendum to MOUs for cohort schools to 
address staff and years’ changes. oy 


IMPROVEMENTS TO STATE INFRASTRUCTURE 


PHASE Il 2015-2016 


ACHIEVEMENT 
FISCAL OF THE SiMR SUSTAINABILITY | SCALE-UP 


Leverage resources in OSE and RESAs to support if 
development, monitoring and evaluation activities. 
Provide IDEA funding to RESAs to establish two 
(2) Regional School Support Specialists (RS*) at i 
least one of whom assumed training, coaching and 
monitoring of WV GRADUATION 20/20 Cohorts. 
Provided IDEA funding of $2,500.00 per school, 
per year to utilize over at least a two-year period Y Y 
to support stipends, substitutes, planning time and 
incentives. 

Provided $20,000.00 grants to Marshall University, 
West Virginia University, Concord University to 
examine coursework and embedded evidence-based 
information on transition in coursework. 

Revised RESA Funding Application to include 
Regional Systemic Improvement Plan. 

Revised RESA Funding Application to include 
specificity about RS°s. 

Revised RESA Funding Application to include 
reading, math and graduation results by RESA. 
Revised LEA Funding Application to include reading, 
math and graduation results. 

Included WVDE Office of Federal Programs, RESA, 
IHE, DRS and PTI as team members of the NTACT Sf 
Capacity Building Institute. 


SIN 
NN 
SING TN NN 
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| ACHIEVEMENT 


FISCAL OF THE SIMR SUSTAINABILITY | SCALE-UP 
Provided IDEA funding of $2,500.00 per school, Vf 
per year to utilize over five-year period to support 

stipends, substitutes, planning time, incentives. Y Y 


IMPROVEMENTS TO STATE INFRASTRUCTURE 


PHASE II 2015-2016 


ACHIEVEMENT 
QUALITY STANDARDS OF THE SiMR SUSTAINABILITY | SCALE-UP 


Revised West Virginia Next Generation English 
language arts and mathematics Standards and of 
Objectives to the West Virginia College-and Career- 
Readiness Standards. 


Conducted campaign WV Academic Spotlights and 
a community evaluation of our standards, with WVU of 
to seek input on suggested revisions to the Next 
Generation Standards and Objectives. 


Provided online IEP access to Next Generation 
Content Standards and Objectives until June 30, 
2016. IEPs effective in 2016-2017 are provided of 
digital access to the West Virginia College- and 
Career- Readiness Standards and the WV Alternate 
Academic Achievement Standards. 


Revise supports for Standard-Based IEPs, ELA and 
math which provides scaffolds for the West Virginia Y 
College- and Career- Readiness Standards. 


ACHIEVEMENT 
QUALITY STANDARDS OF THE SiIMR SUSTAINABILITY | SCALE-UP 


Revised WV Alternate Academic Achievement 
Standards (WVAAAS) to align with WV College- and Y 
Career-Readiness Standards (WVCCRS) in ELA, 
math and science. 


Developed sample course descriptions for four (4) i 
Community Readiness elective courses. 
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Develop WVAAAS for social studies, technology, 
health, physical education and the arts to mirror 
WVCCRS. 


v 


Revised Individual Work Readiness Competencies 
(IWRC). 


v 


IMPROVEMENTS TO STATE INFRASTRUCTURE 
PHASE Il 2015-2016 


ACCOUNTABILITY 


Developed WV GRADUATION 20/20 Frameworks by year 
of implementation. 


ACHIEVEMENT 
OF THE SiMR 


v 


SUSTAINABILITY 


v 


SCALE-UP 


v 


Developed WV GRADUATION 20/20 Implementation 
Manual Guidance for West Virginia Schools and Districts. 


v 


v 


Developed WV GRADUATION 20/20 School 
Implementation Timeline/Benchmarks. 


v 


Developed WV GRADUATION 20/20 School 
Implementation Process. 


AINE 


Develop scheme for inclusion of IHE in years 2, 3, 4 grant 
for examination of coursework. 


Set OSE/RESA (sub grantee) expectations for training, 
coaching and monitoring implementation. 


Set expectations using the Implementation Science Model 
of Exploration, Installation, Initial Implementation, Full 
Implementation. 


Secured MOUs from school cohort participants. 


v 
v 


Secure MOUs from IHE Cohort participants. 


AVN 


Selected by National Technical Assistance Center on 
Transition (NTACT) as an Intensive Technical Assistance 
State. 


v 


ACCOUNTABILITY 


ACHIEVEMENT 
OF THE SiMR 


SUSTAINABILITY 


SCALE-UP 


Joined National Center on Systemic Improvement’s 
(NCSI) Graduation Cross State Collaborative. 


v 


Included Indicators 1, 2, 13 and 14 on LEA Annual Desk 
Audit requiring written Improvement Plan when LEA 
results are below SPR target or state average. 


Included Indicators 1, 2, 13 and 14 on LEA 
Determinations. 


Accessed Targeted Assistance through the Collaboration 
for Effective Educator, Development, Accountability and 
Reform (CEEDAR) Center. 


22 


ACCOUNTABILITY 


ACHIEVEMENT 
OF THE SiMR 


SUSTAINABILITY 


SCALE-UP 


Included Indicator 3b Alternate Assessment 
Participation Rate at 1% and Indicator 14 Response 
Rate on LEA Determinations. 


v 


v 


IMPROVEMENTS TO STATE INFRASTRUCTURE 
PHASE II 2015-2016 


ACCOUNTABILITY 


ACHIEVEMENT 
OF THE SiMR 


SUSTAINABILITY 


SCALE-UP 


Revised Exit and One Year Follow-Up Surveys and 
provided survey results to LEAs in a timely manner. 


Increased use of state level data system (WVEIS) by 
LEAs. 


Increased use of NDPC-SD Dropout Data Toolkit by 
schools and LEAs. 


NN 


AIA 


Increased use by LEAs and schools of WV Early 
Warning System (Attendance, Behavior, Course 
Completion), ZoomWV and ZoomWV-e. 


SONIA 


Included WVDE Offices of Data Management & 
Analysis and Research, Accountability and Data 
Governance staff as team members at the IDC 
Interactive Institutes on Higher Quality Part B Data. 


Developed online IEP interface with Personalized 
Education Plan (PEP), Community Readiness 
Course/Document, IWRC, CTE. 


Revised “Age of Majority” Brochure. 


Revised OSE website and established WV 
GRADUATION 20/20 URL. 


ACHIEVEMENT 


v 
v 


OF THE SiMR 


ACCOUNTABILITY OF THE SiIMR SUSTAINABILITY | SCALE-UP 
Revised “Modified Diploma” to “Alternate Diploma” i 
Brochure 
IMPROVEMENTS TO STATE INFRASTRUCTURE 
PHASE II 2015-2016 
ACCOUNTABILITY ACHIEVEMENT SUSTAINABILITY | SCALE-UP 


Revise Professional Learning, Targeted Technical 
Assistance, and Technical Assistance Resources. 


v 
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Contracted with retired employee to develop/provide 
training on the work of the National Implementation ay 
Resource Network (NIRN) implementation measures 
to OSE and RESA staff. 


Developed one-pager to describe WV 
GRADUATION 20/20. 


Developed PowerPoint for potential participants, 
“What Would WV GRADUATION 20/20 Participation 
Mean for My School?” 


Aligned professional learning content with process of 
Dropout Prevention Intervention Framework (DPIF). 


NEON ON 


Developed series of trainings (webinars) for RS°s Y 
and schools that focus on Dropout Prevention (WV 
Learns e-Learning Course). 


ACHIEVEMENT 
ACCOUNTABILITY OF THE SiMR SUSTAINABILITY | SCALE-UP 


Accessed series of modules from the Transition 
Coalition (University of Kansas) for RS%s and schools Y 
that focus on Transition (WV Learns e-Learning 
course). 


Developed Action Plan format that incorporated fi 
NDPC-SD and CEEDAR Transition IC. 


Developed/provided training on Transition Probe vs 
Practice Profiles. 

Developed Transition Toolkit with DRS, WIA, SILC, 
DD, WVPTI and other agencies. 
Develop/collaborate with WVPTI Transition Training 
Goal #3. 


Convene IHE Forums twice a year. 


Provided workshop for Cohort 1 on improvement and 
utilization of NDPC-SD Core Data Tool data sources. 


Developed FACT Sheets on Dropout, Graduation 
Requirements, Four-Year and Five-Year Adjusted 
Cohort Graduation Rates, Option Pathway and 

Secondary Options for Students with Disabilities. 


ACHIEVEMENT 


XOINININNN SN 


ACCOUNTABILITY OF THE SiIMR SUSTAINABILITY | SCALE-UP 
Developed “Planning for the Future” Brochure. Y SY 
Developed “Transition Services Planner” Booklet oy oy 

Developed “WV Transition Services Guide” Y 
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Developed Transition Tool Kit Y Y 


Provided GRADUATION 20/20 Academies at 
KidStrong Conference. “The Graduation Focused Y 


Principal” 


b. Evidence that SSIP’s evidence-based practices are being 
carried out with fidelity and having the desired effects. 


Discussed in Component B(1), the WVDE is carrying out its duties as described in the 
WV GRADUATION 20/20 MOU. These duties have resulted in the fruition of the short- 
term outcomes listed in the WV GRADUATION 20/20 Measurement Table. Process 
measures at the RESA level indicate the RESAs and RS°s are supporting the School 
Leadership Teams with fidelity. Moreover, focus group results suggest the School 
Leadership Teams and RS°s are working within the steps of the two evidence based 
frameworks (Dropout Prevention Intervention and Transition Practices and Predictors 
Frameworks). 


The WV GRADUATION 20/20 Reflection Rubric will open for data collection beginning 
next month, April 2017. The rubric, based on the stages of implementation in 
implementation science, has been redesigned with significant input from the RS°s. 
Originally a pre/post survey collected twice a year, the rubric is now a retrospective 
pre/post tool collected once a year. The use of a retrospective pre/post type survey 
reduces the burden of work on RS°s and the School Leadership Teams. Some research 
hypothesizes a form of bias called response-shift bias is alleviated through using 
retrospective pre/post surveys. In a 2009 article in the American Journal of Evaluation, 
researchers Moore and Tananis, define response-shift bias as occurring “when a 
participant uses a different internal understanding of the construct being measured 

to complete the pretest and posttest.” Simply put, it is common for participants to 
overestimate their knowledge, skills, and behaviors before exposure to a program or 
intervention. However, after the completion of a program, (and caused by what they 
learned in the program) they may realize their knowledge, skills, and behaviors were 
not truly as high as they first estimated. Therefore, it is possible for participants to rate 
themselves lower in a posttest due to a shift in their frame of reference. This type of bias 
can mask the actual impact of a program. 


While we cannot draw correlations between the work of WV GRADUATION 20/20 
and the state graduation rate, there have been increases in graduation rates among 
students with disabilities over the last several years. 
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c. Outcomes regarding progress toward short-term objectives that 
are necessary steps toward achieving the SiIMR. 


| . 
ae} 


Outcome 


lTimeline/Benchmar 


Increased exposure among RESA, county, and school personnel to address graduation rate 


Outcome 


eh te 
vat exten - 


Increased capacity among school personnel to implement evidence-based strategies 


description increase, drop-out prevention, and transition through implementation of evidence-based 
strategies 
Responsible Performance indicator Measurement/ data _ | Collection Status 
party collection method frequency 
WVDE Professional learning delivery/ Registration and/or | Every summer | Fully 
attendance attendance logs completed 
WVDE Technical Assistance (TA) provided | Meeting agendas Annually Partially 
completed 
WVDE Webinars provided Review of Monthly Fully 
developed webinars completed 
WVDE Initiative documents and resources Document review Annually Fully 
provided completed 
RESA TA provided RS? Monthly Log Monthly Partially 
completed 
RESA Leadership teams developed School Leadership | Annually Fully 
Contact List completed 
RESA Webinars attended RS? Monthly Log Monthly Fully 
completed 
RESA Initiative documents disseminated Document review Annually Fully 
completed 


description 

Responsible Performance indicator Measurement/ data _ | Collection Status 

party collection method frequency 

RESA RS? Monthly Reports Document review Monthly Partially 
completed 

RESA Core Data tool completed Document review Annually Fully 
completed 

RESA Reflection Rubric completed Document review Annually Ready to 
begin 

RESA School Action Plans completed Document review Annually Fully 
completed 

GRADUATION | Levels of support and communication | School Leadership | Annually Fully 

20/20 Evaluator Team focus group(s) completed 
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d. Measurable improvements in the SiMR in Relation to targets. 


YUEAE Vir Gite reper of 


Indicator 1: Graduation 


4-Year Adjusted Cohort Rate 
Students with Disabilities 


80.00% 80.00% 80.00% awe 76.58% 77.85% 81.44% 
3.49%, 97.08% 70 TAge 
: 69.23% 
57.50% 59.60% 59.90% 62.09% 


2009-2010 2010-2011 2011-2012 2012-2013 2013-2014 2014-2015 2015-2016 2016-2017 2017-2018 
~~ 4-Year Adjusted Cohort Graduation Rate —>- Target NEVOICE 


ONE CUS 


Phase Ill Component F: Plans for Next Year 


F. (1) Additional activities to be implemented next year with 
timeline. 


Additional Activities 2017-2018 


Develop and secure MOU for Institutions of Higher Education (IHE) to examine Partially 
coursework (general, special, administrative) through Transition Innovation Completed 
Configurations (IC) from CEEDAR Center. 


Provide $20,000.00 grants to Institutions of Higher Education to examine Partially 
coursework and embed evidence-based practices on transition in coursework. Completed 


Revise Supports for Standards-Based IEPs, English/language arts and Partially 
mathematics which provides scaffolds for the West Virginia College-and Career- | Completed 
Readiness Standards (WVCCRS). 


Alternate Academic Achievement Standards (AAAS) Partially 
Completed 


e Review current course requirements for graduation. 
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e Align Alternate English/language arts, mathematics, and science with West | Partially 


Virginia College-and Career-Readiness Standards (CCRS). Completed 
e Develop Alternate Standards for social studies, the arts, physical Not Started 
education, health, and technology WVCCRS. 
e Develop four (4) sample Community Readiness elective courses. Partially 
Completed 


Alternate Diploma (AD) 
e Revise Policy 2419 and 2510 to incorporate the state-defined Alternate Partially 


Diploma. Completed 
e Require completion of specific courses based on grade-level content Not Started 
standards. 
e Establish course codes for Alternate Courses. Not Started 
e Begin Alternate Diploma eligibility with 2017-2018 9" grade students. Not Started 
e Revise “Modified Diploma” Brochure to “Alternate Diploma.” Completed 
Alternate Assessment (AA) 
e Provide clear and appropriate guidelines for IEP Teams to apply to Completed 
determine whether a student should be assessed on the Alternate 
Assessment. 
e Provide state definition of “students with the most significant cognitive Completed 
disabilities.” 
e Assure that each LEA that assesses more than 1% of students has Not Started 


followed all state guidelines. 


e Plan by SEA for system improvements and monitoring to avoid exceeding | Partially 
the cap. Completed 
e Place percentage of LEA students participating in AA-AAAS in LEA Annual | Completed 
Desk Audit. Improvement Plan required to be developed when LEA 
assesses more than 1% of its students with the AA-AAAS. 
e Revise Intellectual Disability eligibility criteria and align with DSM-5 Completed 
adaptive functioning. 


Post on public site percent of students taking the AA-AAAS. Not Started 


Review and revise structure and procedures for data sharing between SEA, LEA, 
and Division of Rehabilitation Services. (NTACT) 


Not Started 


Coordinate data collection (e.g. definition, timelines) and use across agencies 

to provide a comprehensive picture of service needs, service provided and Not S d 
outcomes (NTACT). ot Starte 
Train WV GRADUATION 20/20 schools to utilize Exit and One-Year Follow-Up Not Started 
Survey results for strategic planning. (NTACT) 

Improve quality of data through collaboration with The IDEA Data Center (IDC) Partially 
and Center for Integrated IDEA Data. (CIID) Completed 
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Develop and provide training on interface of the IEP with the Personalized 
Education Plan (PEP), locally developed Community Readiness Courses. 
Individualized Work Readiness Competencies (IWRC), Career Pathway, Option 
Pathway, Career and Technical Education Clusters, Pathways and Programs of 
Study. (NTACT) 


Partially 
Completed 


Provide training on State Performance Plan Indicator #13. Not Started 


Convene IHE Forums twice a year. (NTACT) Not Started 


Conduct needs assessment of staff to determine gaps in support and/or Not Started 


professional development needs regarding transition. (NTACT) 


Integrate transition program improvement in broader school improvement Not Started 
initiatives. (NTACT) 

Provide training on “Planning For The Future For Students With Disabilities” Not Started 
Brochure for parents and educators. (NTACT) 

Provide training on “Transition Service Planner” a guide for educators in Not Started 


arranging services for students with disabilities with the Division of Rehabilitation 
Services. (NTACT) 


Train on “West Virginia Services Guide” and Pre-Employment Transition Services | Not Started 
(Pre-ETS). (NTACT) 


Train on revisions to Policy 2419 and revised Special Education Process Forms __ | Partially 
to focus on transition. Completed 


Train the Regional School Support Specialist (RS?) to develop county-level Not Started 
Transition Tool Kit within the assigned region. 


Provide college credit for the RS? and county staff developing Transition Tool Kit. | Not Started 


Offer University of Kansas Transition Coalition e-Learning online college courses | Partially 
to West Virginia Educators. Completed 


Develop Resource Manual for strategies and activities that support evidence- Partially 


based practices. Completed 


F. (2) Planned evaluation activities including data collection, 
measures and expected outcomes. 


Evaluation activities for the upcoming school year will follow the activities listed in the WV 
GRADUATION 20/20 Logic Model and outcomes listed in the WV GRADUATION 20/20 
Evaluation Measurement Table. With the use of the Reflection Rubric, we hope to begin to 
measure our intermediate outcomes — implementation fidelity of the Dropout Prevention 
Intervention Framework and CEEDAR’s Transition Practices and Predictors framework. Please 
refer to the WV GRADUATION 20/20 Evaluation Measurement Table: School Year 2016-2017. 
(Appendix E) 
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F. (3) Anticipated barriers and steps to address those barriers. 


Need to revise compliance/monitoring to include 
focus on Graduation, Drop Out, Transition, Post 
School Outcomes, and Participation in Alternate 
Assessment 


Include Post School Survey Response Rate/ 

AA Participation Rate in LEA Annual Desk Audit 

and LEA Determinations. Work with Compliance 
Monitoring Team to develop graduation and drop 
out focus activities. 


Need for county training on State Performance 
Plan Indicator #13 Transition to improve 
compliance 

Institutions of Higher Education need to become 
aware of State emphasis on transition/post 
school outcomes 


Develop and provide 8 RESA trainings and 
archived webinars on SPP/APR Indicator #13. 


Convene IHE Forums twice a year. 


Lack of time for school leadership teams to meet 
impedes planning 


Continue to provide $2,500.00 per year for each 
school for stipends for after- and before-school 
meetings. 


Lack of LEA funding available threatens 
continuation of local initiatives 


School One Year Follow-Up Survey Responses 
need to be increased 


State financial support of professional 
learning and LEA initiatives provided to WV 
GRADUATION 20/20 schools. 


One Year Follow-Up Survey Targeted Response 
Rate included in the LEA Annual Desk Audit and 
LEA Determination. 


School staff including counselors need 

to understand the interface between the 
Individualized Education Program (IEP) and 
Personalized Education Plan (PEP) 


Develop and provide training on interface of the 
IEP with the Personalized Education Plan (PEP), 
Community Readiness Courses, IWRC, Career 
Pathways, Option Pathway, CTE Clusters, 
Pathways, and Programs of Study. 


WV GRADUATION 20/20 Schools need to 
complete Transition Practice Profiles 


Regional School Support Specialists (RS?s) 
ensure any data and/or information required 
for WV GRADUATION 20/20 monitoring is 
completed. 


WV GRADUATION 20/20 Schools need to 
update Action Plans, contact lists and Amended 
MOUs 


Regional School Support Specialists (RS?) 
ensure any data and/or information required 
for WV GRADUATION 20/20 monitoring is 
completed. 


School staff turnover and lack of certified 
teachers hamper continuity of implementation 


Develop and provide eight RESA professional 
learning trainings on SPP/APR Indicator #13. 
Retrain WV GRADUATION 20/20 School 
Leadership Teams and new staff on Frameworks. 
Provide Transition segment in New Teacher Boot 
Camp. 
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Focus groups took place during summer and autumn of 2016. Participants were asked to frame their responses within 
the 2015-2016 school year. 


Some schools experienced difficulty with getting other school staff to buy into the initiative. 


Communication break-downs at multiple levels (i.e., RESA, school administration, team members, 
and other school staff) slowed implementation. 


Staff turnover at school level made it difficult to maintain momentum as a team. 
Losing county or RESA funded graduation coaches was big loss to some schools. 
Finding time to work on the initiative was a barrier for some school teams. 


Access to data (example: sometimes roles such as team leader or graduation coach would not have 
access to student level data). 


Focus groups took place during summer and autumn of 2016. Participants were asked to frame their responses within 
the 2015-2016 school year. 

Communication break-downs at multiple levels, such as: the roll-out of the initiative and whether 
schools could opt-out or not; and school teams not successful in sharing their work, data, and 
outcomes with the rest of their school. 


RS3s reported that school leadership/administrators set the tone, thus schools with leadership/ 
administrators in favor of and involved with the initiative were able to adopt and implement WV 
GRADUATION 20/20 faster and with greater ease than schools that did not have positive support 
from leadership/administrators. 


An initial barrier was finding the right balance of relationship building, communication, level of 
support, and expectations of work-loads at each school; in a support role, RS3s did not have the 
authority to hold school teams accountable for completing tasks (such as the School Action Plan). 
The positive involvement and support of school leadership/administration was pivotal in ensuring 
the work required by the initiative was completed. 


Time available to spend at each school; some schools would have benefited from more frequent 
visits than were possible due to the large number of schools participating in the WV GRADUATION 
20/20 initiative. 


Internet access/speed/reliability an issue at some schools. RS3s cannot rely on ability to access 
internet on-site; can impede access to tools such as ZOOMWYV, Early Warning System, and WV 
GRADUATION 20/20 website. 


Additional staff required to support WV Office of Special Education provided funding 
GRADUATION 20/20 at RESA for eight (8) RESAs to employ Regional School 
Support Specialists (RS?s) 

Formalized agreements, MOUs, requirements Developed MOUs outlining requirements of 
developed within LEAs, RESAs, schools, IHEs WVDE, RESA, LEA and schools. 


Lack of defined process for implementation of Developed West Virginia GRADUATION 20/20 


WV GRADUATION 20/20 Implementation Manual. 

Need for Communication Plan Resources developed and utilized for LEAs, 
RS?s, and Cohort 1 schools. 

Need for Implementation Science professional Provided training to OSE staff and RSs on 

learning Implementation Science. 
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Utilize Implementation Framework WV Implementation Framework in the WV 
GRADUATION 20/20 Implementation Scale for | GRADUATION 20/20 Implementation Scale 
schools to use for schools to use (see attachment WV 
GRADUATION 20/20 Implementation Scale) 
Need to reorganize compliance/monitoring to LEA Results Improvement Plan addressed in 
include results in a LEA Results Improvement 2014-2015. 
Plan 
Need to require RESAs to complete Regional RESA Application for 2015-2016 included 
Systemic Improvement Plan Regional Systemic Improvement Plan. 
Review and approve LEA Improvement Process_ | Improvement Plans in LEA Annual Desk Audits 
Submitted with Annual Desk Audit reviewed by Offices of Special Education and 
Federal Programs. 


F. (4) The State describes any needs for additional support and/or 
technical assistance. 


DATA 


e Provision of support for integration of IDEA data and West Virginia’s longitudinal data 
system through the Center for the Integration of IDEA Data (CIID) and IDEA Data 
Center (IDC). 


Infrastructure Development 
e Access to resources on transition and dropout prevention evidence-based practices. 
e Facilitation of collaborative meeting with IHE partners. 


e Provision of national conferences focusing on SSIP development, implementation, 
and evaluation. 


e Access to Cross State Learning Collaborative and other States’ resources through 
the National Center for Systemic Improvement (NCSI). 


e Provision of support for Alternate Assessment and Alternate Diploma through the 
State Collaborative on Assessment and Student Standard’s (SCASS) Assessing 
Special Education Students (ASES). 


Support for LEA Implementation of EBPs 


e Access to nationally-recognized content specialist on transition evidence-based 
practices (EBP) through the Collaboration for Effective Education Development, 
Accountability and Reform (CEEDAR). 


e Access to nationally-recognized content specialists on the National Dropout 
Prevention Intervention Framework (DPIF). 


e Assistance in developing blended professional learning modules for RESA RS3s and 
school-based teams on transition through the University of Kansas. 


e Provision of on-site training for WY GRADUATION 20/20 Cohorts. 
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Evaluation 
e Evaluation of SSIP utilizing OSEP’s evaluation tool. 


e Assist State in examination of Indicators 1, 2, 13, and 14 data and Division of 
Rehabilitation Services performance data. Provide consultation regarding collecting, 
analyzing, and using valid and reliable data to identify strengths, needs and 
priorities regarding secondary education and transition services through the National 
Technical Assistance Center on Transition (NTACT). 


Stakeholder Involvement in Phase II 
e Improve collaboration between SEA and Division of Rehabilitation Services to 
enhance services for students with disabilities (NTACT). 


e Improve collaboration with adult service agencies, post-secondary education, 
employer, and business organizations. 


e Suggest members of stakeholder groups (NTACT). 
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Appendix B 


YEARS 1-2 DROPOUT PREVENTION INTERVENTION FRAMEWORK 


Step 1. Utilize State and School Leadership Teams 
C View “What Would Participation In GRADUATION 20/20 Mean For My 
School?” Webinar 
0 Review GRADUATION 20/20 process Years 1 and 2. 
0 Review GRADUATION 20/20 School Memorandum of Understanding 
and Commitments/Requirements Documents. 
C Discuss at the school level the graduation/dropout rate and/or 
achievement gaps of subgroups. 
Oo Secure Memorandum of Understanding from schools desiring to 
participate in GRADUATION 20/20 project. 
C Identify Schoo! Leadership Team members. 
2 Identify School Leadership Team Leader. 
Determine meeting dates (at least 1 time per month). 
Step 2. Analyze Data 
oi Enter data for the three prior years into the Core Dropout Data Tool. Use 
the questions in the accompanying discussion guide to help identify 
trends, patterns and needs in the data. Look also at your school’s 
demographics/infrastructure data. Examine student performance in the 
following areas: 
Achievement-Course Passing Rate 
Attendance 
Discipline- Office and Disciplinary Referrals 
School Climate 
Student Engagement 
Transition 
Graduation/Dropout Data/Race Ethnicity/Students with 
Disabilities 
Step 3. Identify Target Areas for Intervention 
Oo Identify and prioritize the areas of need based on data. 
C Determine those students who will be targeted: 
> Selected group (example: 9" grade students with 
disabilities). 
»  School-wide/Universal 
> Identified group of students based on at-risk indicators. 


VVVVVV WV 


Step 4. Develop Goal for School Strategic Plan 
0 Identify and select evidence-based strategies/interventions to drive 
improvement. 
0 Complete each section of School GRADUATION 20/20 Dropout 
Prevention Action Plan: 
Determine goal 
Identify measurable outcomes and gather baseline data 
Determine activities/strategies/interventions 
Establish reasonable timelines 
Identify person(s) responsible 
Evaluation/Progress Check 
0 Identify implementation concerns and work to remove barriers. 
Step 5. Implement, Monitor and Evaluate 
implement 
QO Train staff in professional leaming specific to the implementation of the 
School Action Plan, making sure all staff members demonstrate a clear, 
consistent and shared understanding of what the faculty and students 
are expected to know, understand and do. 
O Communicate goals to targeted students and explain the intervention(s). 
0 Implement School Action Plan according to the determined timelines. 
Monitor 
O Develop assessment tools measuring performance (i.e., school 
developed walk-through observations, awareness walks, survey, 
benchmarks, protocols, logs, charts, student portfolios, common 
assessments, etc.) that will provide consistent data over time to monitor 
improvement of the targeted area (i.e., achievement, attendance, 
discipline, etc.). 
O Develop a data collection schedule, collect the data, record it in a 
spreadsheet and utilize the data to monitor progress. 
O Continuously adjust strategies/School Action Plan steps based on 
analysis and review of data. “The School Action Plan should be 
updated and revised, as appropriate. 


VVVVVV 


Evaluate 

O Collect the data for your measurable outcomes in order assess 
improvement, analyze causes for unsatisfactory results and identify 
successes. 

O Based on findings, make revisions to the School Action Plan in order to 
maximize its’ effectiveness for the upcoming school year. 

O Share findings with faculty, students, parents, community, WVDE, RESA 
and Local Board of Education. 

O Celebrate Successes! 


YEARS 2-3 CEEDAR TRANSITION PRACTICES FRAMEWORK 


Step 1. Utilize State and School Leadership Teams 
O Use “What Would Participation in GRADUATION 20/20 Mean For My 
School?” Webinar to orient new staff in the building to GRADUATION 
20/20. 
Review GRADUATION 20/20 Process Years 2 and 3. 
Discuss at the school level the transition practices in place. 
Re-establish School Leadership Team members: 
Re-identify School Leadership Team Leader. 
Determine meeting dates (at least 1 time per month). 
Step 2. Analyze Data 
QO Complete Transition Practices Framework: School Level Practice 
Profile as a self-assessment to determine the most critical needs with 
the transition program components: 
> Student-Focused Planning 
> Student Development 
> Family Involvement 
> Program Structure 
> Interagency Collaboration 
O Determine the level of implementation of Transition Practices: 
> Exploration 
> Installation 
> Initial Implementation 
> Full Implementation 
Step 3. Identify Target Areas for Intervention 
QO Identify and prioritize the areas of need based on Practice Profile data. 
QO Determine whether to focus on one component, several or all of them. 
O Note the gap between the desired level and current level. 


ooo & 


Step 4. Develop Goal for School Strategic Plan 
O Identify and select evidence-based strategies/interventions to drive 
improvement. 
QO Complete each section of School GRADUATION 20/20 Transition Action 
Plan: 
Determine goal 
Identify measurable outcomes and gather baseline data 
Determine activities/strategies/interventions 
Establish reasonable timelines 
Identify person(s) responsible 
Evaluation/Progress Check 
O Identify implementation concems and work to remove barriers. 


VVVVVV 


Step 5. Implement, Monitor and Evaluate 


Implement 


0 


0 

0 
Monitor 

0 


Evaluate 
oO 


Train staff in professional learning specific to the implementation of the 
School Action Plan, making sure all staff members demonstrate a clear, 
consistent and shared understanding of what the faculty and students 
are expected to know, understand and do. 

Communicate goals to targeted students. 

Implement School Action Plan according to the determined timelines. 


Develop assessment tools measuring performance (i.e., school 
developed walk-through observations, awareness walks, survey, 
benchmarks, protocols, logs, charts, student portfolios, common 
assessments, etc.) that will provide consistent data over time to monitor 
improvement of the targeted area (i.e., achievement, attendance, 
discipline, etc.). 

Develop a data collection schedule, collect the data and utilize the data 
to monitor progress 

Continuously adjust strategies/School Action Plan steps based on 
analysis and review of data. *The School Action Plan and Practice 
Profile should be updated and revised as appropnate. 


Collect the data for your measurable outcomes in order to assess 
improvement, analyze causes for unsatisfactory results and identify 
successes. 

Based on findings, make revisions to the School Action Plan in order to 
maximize its’ effectiveness for the upcoming school year. 

Share findings with faculty, students, parents, community, WVDE, RESA 
and Local Board of Education. 

Celebrate Successes! 
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Appendix F 


WV GRADUATION 20/20 Reflection Rubric 2016-2017 (print version) 


Welcome to the WV GRADUATION 20/20 Reflection Rubric 


By completing this rubric you are consenting to participate in a research study. The purpose of the 
study is to determine the extent to which participating schools in the West Virginia GRADUATION 
20/20 initiative are implementing the steps of either the Dropout Prevention Intervention Framework 
(DPIF) or the CEEDAR Transition Practices Framework. The results of this research study will be 
used to help determine revisions to the WV GRADUATION 20/20 initiative at the state, RESA, and 
school levels. Your participation in the study includes completing this survey once during the 
school year; it should not take more than 20 minutes of your time to complete. You will be 
presented with a series of items and asked to indicate your responses by selecting from multiple 
choice options. 


Participation in this research study poses no more risk than you would encounter during the course 
of a normal day. It is the intention that results from this rubric will be used by the WV GRADUATION 
20/20 School Leadership Teams, the Regional School Support Specialists (RS?s), and the West 
Virginia Department of Education (WVDE) to improve supports and activities related to 
implementation of the DPIF and/or the Transition Practices Framework. All responses to this data 
collection activity shall remain completely confidential and no identification of individual 
participants will occur. All results will be reported in aggregate. 


There is no compensation for taking part in this research study. Please note that your participation 
is completely voluntary and you may stop at any time. You will experience no penalties or loss of 
benefits if you should refuse to participate in the research. If you have questions about the research 
associated with the WV GRADUATION 20/20 initiative or this rubric, you may contact Amber Stohr, 
Coordinator, at the WVDE Office of Research, Accountability, and Data Governance at 304.558.7881 
or astohr@k12.wv.us. 


This research study has been reviewed and given exempt status by the WVDE Institutional Review 
Board (IRB). 


Thank you for your participation! 


WV GRADUATION 20/20 Reflection Rubric 2016-2017 (print version) 


Instructions 


These rubrics are to be used to assess the fidelity with which the WV GRADUATION 20/20 initiative 
has been implemented by participating schools. 
They are NOT to be usedto assess the fidelity with which any particular intervention selected by a 
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school has been implemented. 


The reflection rubric is designed to capture thestages of implementation at two specific time 
periods. First, choose the stage that best reflects the implementation level near the beginning of 
the school year (Autumn 2016). Second, choose the stage that best reflects the implementation level 
at the end of the school year (Spring 2017). 


As a group, each WV GRADUATION 20/20 School Leadership Team is to complete the reflection 
rubric near the end of the school year. 


The Regional School Support Specialists (RS*s) are to complete a reflection rubric for each of the 
schools they support, also near the end of the school year. 


The intent of the rubric is to allow schools to identify areas of strength and potential barriers as 
they work through the steps outlined in the Dropout Prevention Intervention Framework and/or the 
CEEDAR Transition Practices Framework. 


WV GRADUATION 20/20 Reflection Rubric 2016-2017 (print version) 


RESA/School Information 


Role: 
~) Regional School Support Specialist (RS3) 


~ >) WV GRADUATION 20/20 School Leadership Team 


Location: 
) RESA1 _) RESA5 
) RESA2 ‘+d RESA6 
) RESA3 +) RESA7 
() RESA4 _) RESA8 
School name: 


po 
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For your school's WV GRADUATION 20/20 initiative, what is currently the main focus? 
) Dropout prevention 
) Transition practices 


Both dropout prevention and transition practices 


WV GRADUATION 20/20 Reflection Rubric 2016-2017 (print version) 


Step 1. Utilize school leadership team 


For each core activity, choose the implementation level that is most applicable to the beginning of 
the school year, and near the end of the school year. 


Key components: 
¢ Establish a WV GRADUATION 20/20 School Leadership Team (hereafter GRAD 20/20 Team or the 


team). 

¢ Review and/or receive training on the components of the evidence based framework (Dropout 
Prevention or Transition Practices). 

¢ Take ownership and commit to the implementation process. 


Core activity: Establish a WV GRADUATION 20/20 School Leadership Team. 


Initial 
Exploration: Installation: Implementation: Full 
Not Yet Identifying Need - Establishing Making Implementation: 
Established - No Planning for Resources - The Adjustments - Well-Integrated 
attempt has been identifying and team is established; Most recruitment of | - Recruitment is 
made to establish recruiting team recruitment has team members is complete, the team 
the team members has begun begun complete is ready to meet 


Near the beginning of 7 7 
the school year (Autumn ) C ) ) 
2016) 


Near the end of the 
school year (Spring 
2017) 
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Core activity: Train GRAD 20/20 Team members on the primary components of either the Dropout 


Prevention Intervention Framework or the Transition Practices Framework. 


Initial 
Implementation: 
Installation: Making 
Establishing Adjustments - 


Most members 
trained on most 
aspects of the 
framework 


Exploration: Resources - Some 
Identifying Need - members trained on 
Atraining plan is in some aspects of the 

development framework 


Not Yet 
Established - No 
training has taken 

place 


Near the beginning of -. lan r~ 
the school year / SS i 


Near the end of the ’ oo» 
school year hd = 


Core activity: Establish ownership and commitment for the project implementation process. 


Not Yet Exploration: 
Established - Identifying Need Installation: Initial 
The team has not _ - Planning for Establishing Implementation: 
taken ownership implementation Resources - Early Making Adjustments 
of the project or has begun; project stages of - Implementation 
committed to ownership implementation; some underway; moderate 
implementation unknown ownership/commitment ownership/commitment ownership/commitment 


Near the beginning - a 
of the school year < 


Near the end of the lan “> 
school year - 


WV GRADUATION 20/20 Reflection Rubric 2016-2017 (print version) 


Full 
Implementation: 
Well-Integrated -All 
members trained on 
the primary 
components of the 
framework 


Full Implementation: 


Well-Integrated - 


Implementation in full 


swing; strong 


Step 2. Analyze data 


For each core activity, choose the implementation level that is most applicable to the beginning of 


the school year, and near the end of the school year. 


Key components: 
¢ Examine school data. 


* Complete the Core Data Tool or the School-Level Practice 
Profile. 


¢ Analyze data to determine trends/areas of need. 
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Core activity: Examine school data related to the Dropout Intervention Framework or the Transition 
Practices Framework. 


Initial 
Implementation: 
Installation: Making Full 
Not Yet Exploration: Establishing Adjustments -Most Implementation: 
Established -An Identifying Need- Resources - The data have been Well-Integrated - 
examination of Planning for the team has begun to examined; All school data have 
school data has not analysis of school examine school discussions have been examined and 
begun data has begun data begun discussed in detail 
Near the beginning of 
the school year (Autumn 
2016) 
Near the end of the 
school year (Spring 
2017) 
Core activity: Complete the Core Data Tool or the School-Level Practice Profile. 
Initial 
Implementation: 
Exploration: Installation: Making Full 
Not Yet Identifying Need - Establishing Adjustments - Implementation: 
Established -No Planning forhow to Resources -Some Most sections of the Well-Integrated - 
work has begun to complete the portions of the tool/profile All sections of the 
complete the tool/profile has tool/profile have have been tool/profile have 
tool/profile begun been completed completed been completed 


Near the beginning of 
the school year 


Near the end of the 
school year 


Core activity: Use the completed Core Data Tool or School-Level Practice Profile to determine and 
discuss trends in the data. Use trends to inform data driven decision making for WV GRADUATION 20/20 


interventions. 


Initial 
Implementation: Full 

Exploration: Installation: Making Implementation: 
Not Yet Identifying Need - Establishing Adjustments - Well-Integrated - 

Established - Planning on how to Resources - Some Most of the Examination is 

Determination of | use the completed __ of the tool/profile tool/profile have complete; 

data trends has not tool/profile has have been been examined for trends/areas of 

begun begun examined for trends trends need are identified 


Near the beginning of 
the school year 


Near the end of the 
school year 
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Step 3. Identify target areas for intervention 


For each core activity, choose the implementation level that is most applicable to the beginning of 
the school year, and near the end of the school year. 


Key components: 
¢ Identify and prioritize areas of need based on the data analysis. 


¢ Determine the level of intervention (i.e., a cohort of students based on set demographics or risk 
indicators, a particular subgroup such as 9th grade special education students, or school 
wide/universal). 


Core activity: Identify areas of need that emerged from the data analysis in Step 2. 


Exploration: 
Identifying Need Initial Full 
Not Yet - Planning has Installation: Implementation: Implementation: 
Established - begun on the Establishing Making Well-Integrated - 
Identification of process of Resources -The Adjustments - The The team has 
areas of need has __ identifying areas of team has identified team identified most identified all areas 
not begun need some areas of need areas of need of need 


Near the beginning of 
the school year (Autumn 
2016) 


Near the end of the 
school year (Spring 
2017) 


Core activity: Prioritize areas of need that emerged from the data analysis in Step 2. 


Exploration: Initial Full 
Not Yet Identifying Need - Installation: Implementation: Implementation: 
Established - Planing for how Establishing Making Well-Integrated - 
Prioritizing the areas __ to prioritize the Resources -The Adjustments - The The team has 
of need has not areas of need has team has prioritized team has prioritized prioritized all areas 
begun begun some areas of need most areas of need of need 


Near the beginning of ~~ a a a — 
the school year . 


Near the end of the 
school year 
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Core activity: Determine the level of intervention. Will it be a cohort, a subgroup, or school wide? 


Initial 
Installation: Implementation: 
Not Yet Exploration: Establishing Making Full 
Established - Identifying Need- Resources- The Adjustments -The Implementation: 
Determining the — Planning for how to team has team has Well-Integrated - 
level(s) of select the level(s) of determined level(s) determined level(s) The team has 
intervention has not _ intervention has of some of determined levels of 
begun begun interventions most interventions all interventions 


Near the beginning of 
the school year 


Near the end of the — a 
school year 


WV GRADUATION 20/20 Reflection Rubric 2016-2017 (print version) 


Step 4. Develop goal for school strategic plan 


For each core activity, choose the implementation level that is most applicable to the beginning of 
the school year, and near the end of the school year. 


Key components: 
¢ Identify evidence-based strategies/interventions to drive improvement. 


* Complete the School Action Plan. 
¢ Identify implementation concerns and work to remove barriers. 


Core activity: Identify evidence-based strategies and/or interventions to drive improvement. 


Not Yet Exploration: Installation: Initial 
Established - Identifying Need - Establishing Implementation: 
Work to identify Planning for how Resources -Some Making Adjustments - Full Implementation: 
strategies / to identify strategies/interventions Most Well-Integrated - All 
interventions — strategies/interventions have been strategies/interventions strategies/interventions 
has not begun has begun identified/discussed have been identified have been identified 
Near the 
beginning of the 
school year VY ~ - VY VY 
(Autumn 2016) 


Near the end of 
the school year 
(Spring 2017) 
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Core activity: Complete all sections of the School Action Plan [e.g., focus areas, baselines, goals, 
objectives, strategies, activities, persons responsible, timelines, and evaluation]. 


Initial 
Exploration: Installation: Implementation: Full 
Not Yet Identifying Need Establishing Making Implementation: 
Established - Work - The team plans to Resources-Some Adjustments -All Well-Integrated - 
to complete the meet to review the sections of the sections of the Implementation of 
School Action Plan SchoolAction Plan School Action Plan SchoolAction Plan the School Action 
has not begun template are complete are complete plan has begun 
Near the beginning of ~ “a ~ 
the school year p 
Near the end of the 
school year 
Core activity: Identify implementation concerns and work to remove barriers. 
Installation: Full 
Not Yet Exploration: Establishing Initial Implementation: 
Established - Identifying Need Resources - Some Implementation:Making Well-Integrated - 
Work to identify - The team plans to concerns/barriers Adjustments -All Work to alleviate 
concerns and meet to discuss have been barriers identified; and/or remove 
barriers has not identifying identified and discussing how to identified barriers 
begun concerns/barriers discussed alleviate them has begun 


Near the beginning of ~ ~ a ~) 
the school year : . 


Near the end of the 
school year 
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Step 5. Implement, monitor, and evaluate 


For each core activity, choose the implementation level that is most applicable to the beginning of 
the school year, and near the end of the school year. 


Key components: 

¢ Implement the School Action Plan with fidelity. 

¢ Monitor the implementation of the School Action Plan. 
¢ Evaluate the effectiveness of the School Action Plan. 
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Core activity: If needed, provide professional learning (PL) to school staff specific to implementing the 
School Action Plan. Ensure staff members demonstrate a clear, consistent, and shared understanding of 
what the faculty and students are expected to know, understand, and do. 


Initial Full 
Installation: Implementation: Implementation: 
Exploration: Establishing Making Well-Integrated - 
Identifying Need - Resources- Aplan Adjustments - PL completed; 
Not Yet The professional to share Some faculty 
Established - Work learning (PL) needs expectations with PL completed; fully understand 
for this activity has have been faculty is in expectations shared action plan 
not begun determined development with faculty expectation 


Near the beginning of 
the school year (Autumn 
2016) 


Near the end of the 
school year (Spring 
2017) 


Core activity: Communicate School Action Plan goals to targeted students (and their families). 


Installation: Initial 
Establishing Implementation: Full 
Not Yet Exploration: Resources - Making Implementation: 
Established - No Identifying Need - Communication Adjustments - Well-Integrated - 
communication of | Acommunication plan complete; Comm. plan in Comm. plan fully 
the School Action plan is in the some effect; most implemented; all 
Plan has taken process of being students/families students/families students/families 
place developed contacted contacted contacted 
Near the beginning of 
the school year 
Near the end of the 
school year 
Core activity: Implement the School Action Plan according to the determined timeline. 
Initial 
Exploration: Installation: Implementation: Full 
Not Yet Identifying Need Establishing Making Implementation: 
Established - - Planning for Resources - Some Adjustments - Well-Integrated - 


Implementation of 
the action plan has 


not begun begun 


Near the beginning of 
the school year (Autumn 
2016) 


Near the end of the 
school year (Spring 
2017) 


implementation of 
the action plan has 
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activities in the 
action plan have 
taken place 


Many activities are 
completed; some 


data collected 


Most/all activities 
completed; data 
collected 


Core activity: Determine what data is needed to monitor implementation of programs and/or interventions. 
Identify data sources, develop tools if necessary, and set a data collection schedule. 


Exploration: 
Not Yet Identifying Need - 
Established - No Planning for 


data has been 
identified for 
monitoring needs 


identifying data 
needs and sources 
has begun 


Near the beginning of ~~. 
the school year 


Near the end of the ’ o» 
school year hd = 


Initial 
Implementation: Full 
Installation: Making Implementation: 
Establishing Adjustments Well-Integrated 
Resources - Some - Most - All needs/sources 
data needs and needs/sources identified; 


tools/collection 
schedule done 


identified; tools 
being developed 


sources have been 
identified 


Core activity: Review or analyze data on an ongoing basis to make adjustments to the School Action Plan. 


Exploration: 
Identifying Need - 
Planning on how to 


Not Yet 
Established - No 


review or analysis approach the review analysis of data has review/analysis has 
and/or data analysis 


has occurred 


Near the beginning of ~ lax 
the school year ~~ 


Near the end of the ~ lm 
school year 


Installation: Initial Full 
Establishing Implementation: Implementation: 
Resources - Making Well-Integrated - 


Adjustments are 
based directly on 
data review/analysis 


Review and/or Adjustments - The 


begun been completed 


Core activity: Communicate findings with faculty, students, families, the community, and other stakeholders. 


Exploration: 
Identifying Need - 
A communication 
plan is in the early 
stages of 
development 


Not Yet 
Established - No 
communication of 
findings has taken 

place 


Near the beginning of 
the school year 


Near the end of the ~ 
school year 


Full 
Initial Implementation: 
Installation: Implementation: Well-Integrated - 
Establishing Making All aspects of the 


Resources - The 
communication plan communication plan 
has been completed is in effect 


Adjustments - The communication plan 
have been 
implemented 
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Additional comments 
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Please provide any additional comments, suggestions, successes, and/or barriers: 
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Appendix G 


GRADUATION 20/20 Timeline/Benchmarks 
Year 1 DROPOUT PREVENTION INTERVENTION FRAMEWORK 
Suggested Timeline/Benchmarks 
Timeline is dependent on school initiative start date 


Step 1. UTILIZE STATE AND SCHOOL LEADERSHIP TEAMS 


TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 
1. Discuss at the district and school level 
the graduation/dropout rate and/or v v v v 
achievement gaps of subgroups. 
2. Identify School Leadership Team Vv 7 
members. 
3. Determine school meeting dates (at Vv 4 


least 1 time per month) and publish. 


4. — Complete Dropout Prevention 


Sessions (Webinars/e-Learning For v v v v v v v v v v v 
Educators). 
5. Complete W GRADUATION Vv Vv 


20/20 Reflection Rubric (pre). 


Step 2. ANALYZE DATA 


TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 


1. Complete the NDPC-SD Core 
Data Tool using the accompanying 
discussion guide if needed. Look at 
school demographics/ infrastructure. 
Examine student performance in the v v v 
areas of achievement, attendance, 
discipline, school climate, student 
engagement, family involvement, 
transition and graduation/ dropout 
data. 


2. — Analyze the compiled data to Vv Vv Vv 
determine any trends. 


Step 3. IDENTIFY TARGET AREAS FOR INTERVENTION 
TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 


1. Identify and prioritize the areas of ZY Vv Vv 
need based on data. 


2. Determine those students that will be 


targeted. 
a. Selected group (example - 9th 
grade students with disabilities) v v 


b. — School-wide/universal 
c. Identified group of students 
based on at-risk indicators 


Step 4. DEVELOP GOAL FOR SCHOOL STRATEGIC PLAN 
TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 


1. Identify evidence-based strategies/ Vv Vv Y 
interventions to driveimprovement. 


2. Complete each section of the School 
Action Plan. 
a. Determine goal 
b. — WV GRADUATION 20/20 
Timeline/ Benchmarks v v v v ff 7 
c. Determine activities/strategies/ 
interventions 
d. — Establish reasonable timelines 
Identify person(s) responsible 
Evaluation/Progress Check 


m oO 


Step 4. DEVELOP GOAL FOR SCHOOL STRATEGIC PLAN (continued) 


TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 


3. Identify implementation concerns and Vv v v v v v 
work to remove barriers. 


Step 5. IMPLEMENT THE SCHOOL ACTION PLAN WITH FIDELITY 
TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 


1. Train staff in professional learning 
specific to the implementation of the 
School Action Plan, making sure all 
staff members demonstrate a clear, v v v v v v v v 
consistent and shared understanding 
of what the faculty and students are 
expected to know, understand and do. 


2. Communicate goals to targeted 


students in order to implement goal v v v v v v 
setting. 
3. Implement the School Action Plan Vv v v of v 


according to determined timelines. 


Step 6. MONITOR THE IMPLEMENTATION OF THE SCHOOL ACTION PLAN 


TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 


1. Develop assessment tools 
measuring student performance 
(e.g., walk-through observations, 
survey, benchmarks, protocols, logs, 
charts, student portfolios, common Vv Vv 7 Vv # 
assessments, etc.) that will provide 
consistent data over time to monitor 
improvement of the targeted area 
(e.g., achievement, attendance, 
discipline, etc.). 


2. Develop a data collection schedule, 
collect the data and utilize the data to v v v v v v v v 
monitor progress. 


3. Continuously adjust strategic/action 
plan steps based on analysis and 
review of data. Remember that the Py, v F Vv Vv Vv a v ev 
School Action Plan and Data Probe 
should be updated and revised as 
appropriate. 


Step 7. EVALUATE THE EFFECTIVENESS OF THE SCHOOL ACTION PLAN 
TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 


1. Collect all school level data in order 
to detect patterns, analyze causes v v7 a v 
for unsatisfactory results and identify 
successes. 


2. Based on findings, make revisions 
to the School Action Plan in order va v v a 
to maximize its effectiveness for the 
upcoming school year. 


3. Share findings with faculty, students, v v v v 
community, WVDE, RESAand LEA. 

4. Complete W GRADUATION of v 
20/20 Reflection Rubric (post). 

5. — Celebrate Successes! v v v 


Year 2 CEEDAR TRANSITION PRACTICES FRAMEWORK 
Suggested Timeline/Benchmarks 


GRADUATION 20/20 Timeline/Benchmarks 


Timeline is dependent on school initiative start date 


Step 1. UTILIZE STATE AND SCHOOL LEADERSHIP TEAMS 


TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 
1. Discuss at the district and school level 
the graduation/dropout rate and/or v v v v 
achievement gaps of subgroups. 
2. Identify School Leadership Team rz Vv 
members. 
3. Determine school meeting dates (at Vv ee 
least 1 time per month) and publish. 
4. — Complete Transition Practices Vv v7 Vv 
Sessions (e-Learning For Educators). 
5. Complete GRADUATION 20/20 Vv Vv 


Reflection Rubric (pre). 


Step 2. ANALYZE DATA 


TASK DESCRIPTION 


AUG 


SEPT 


OCT 


NOV 


DEC 


JAN 


FEB 


MAR 


APR 


MAY 


JUNE 


JULY 


1. Complete the Practice Profile using 
the accompanying discussion 
guide. Look at school programs/ 
schedule/ infrastructure. Examine 
student performance in the areas of 
achievement, student engagement, 
family involvement, transition, 
graduation/dropout data, student exit 
data and one-year follow-up surveys. 


2. Analyze the compiled data to 
determine any trends. 


Step 3. IDENTIFY TARGET AREAS FOR INT 
TASK DESCRIPTION 


ERVENT! 
AUG 


OCT 


NOV 


DEC 


JAN 


FEB 


MAR 


APR 


MAY 


JUNE 


JULY 


1. Identify and prioritize the areas of 
need based on the Practice Profile and 
additional program data. 


2. Determine those programs/practices 
that will be targeted. 
a. School-wide/universal 
b. Identified group of students 
based on at-risk indicators 


Step 4. DEVELOP GOAL FOR SCHOOL STRATEGIC 


TASK DESCRIPTION 


AUG 


PLAN 
SEPT 


OCT 


NOV 


DEC 


JAN 


FEB 


MAR 


APR 


MAY 


JUNE 


JULY 


1. Identify evidence-based strategies/ 
interventions to driveimprovement. 


2. Complete each section of the School 

Action Plan. 

a. Determine goal 

b. | WV GRADUATION 20/20 
Timeline/ Benchmarks 

c. Determine activities/strategies/ 
interventions 

d. — Establish reasonable timelines 

e. _ Identify person(s) responsible 

f.  Evaluation/Progress Check 


3. Identify implementation concerns and 
work to remove barriers. 


Step 4. DEVELOP GOAL FOR SCHOOL STRATEGIC PLAN (continued) 


TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN FEB | MAR | APR | MAY | JUNE | JULY 
4. Complete Transition Coalition Vv Vv 
Best Practices Module 
Step 5. IMPLEMENT THE SCHOOL ACTION PLAN WITH FIDELITY 
TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN FEB | MAR | APR | MAY | JUNE | JULY 


1. Train staff in professional learning 
specific to the implementation of the 
School Action Plan, making sure all 
staff members demonstrate a clear, v v v v v v v v 
consistent and shared understanding 
of what the faculty and students are 
expected to know, understand and do. 


2. Communicate goals to targeted 
students in order to implement goal v v v v v v v 
setting. 


3. Implement the School Action Plan 
according to determined timelines. 


Step 6. MONITOR THE IMPLEMENTATION OF THE SCHOOL ACTION PLAN 


TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 


1. Develop assessment tools measuring 
student performance (e.g., walk- 
through observations, awareness 
walks, survey, benchmarks, protocols, 
logs, charts, student portfolios, 
common assessments, etc.) that will 
provide consistent data over time to 
monitor improvement of the targeted 
area (e.g., achievement, student 
engagement, transition, etc.). 


2. Develop a data collection schedule, 
collect the data and utilize the data to v v v v v v v v 
monitor progress. 


3. Continuously adjust strategic/action 
plan steps based on analysis and 
review of data. Remember that the 
School Action Plan and Practice 
Profile should be updated and revised 
as appropriate. 


Step 7. EVALUATE THE EFFECTIVENESS OF THE SCHOOL ACTION PLAN 
TASK DESCRIPTION AUG | SEPT | OCT | NOV | DEC | JAN | FEB | MAR | APR | MAY | JUNE | JULY 


1. Collect all school level data in order 
to detect patterns, analyze causes 
for unsatisfactory results and identify 
successes. 


2. Based on findings, make revisions 
to the School Action Plan in order 
to maximize its effectiveness for the 
upcoming school year. 


3. Share findings with faculty, students, 
community, WVDE, RESAand LEA. 


4. Complete W GRADUATION 
20/20 Reflection Rubric (post). 


5. Celebrate Successes! v v v 


Appendix H 


EXIT SURVEY REPORT 2015-2016 


NOTE: Reports produced for each county and school participating in the 
WV STATE RESULTS survey. These reports were shared with appropriate stakeholders. 


Total number of responses: 1831 


Exit reason % Gender % Race/Ethnicity % 

Grad. Standard Diploma 84.2% Female 33.3% White 93.9% 
Grad. Modified Diploma 12.4% Male 66.7% Other 6.1% 
Dropped out 3.4% 

Primary Exceptionality % Survey item Yes (%) 
Autism 3.8% Have current driver’s license 34.0% 
Blindness and Low Vision 0.6% Earned CTE Certificate 46.3% 
Deaf/Blindness 0.1% Earned CTE Credential 36.5% 
Deaf 0.3% Any work experience* 97.6% 
Developmental Delay 0.1% Any extracurricular activities** 97.1% 
Emotional/Behavior Disorder 3.0% Special ed. classes helped in general ed. classes 83.9% 
Gifted (Grades 9-12) 1.3% Not in general education classes 8.6% 
Gifted (Grades 1-8) 0.1% *Any work experience includes work-based learning, part-time 
Hard of Hearing 0.7% job, summer employment, and other. **Any extracurricular 

Mild Mental Impairment 17.6% activities include clubs, performing arts, volunteering, sports, 
Moderate Mental Impairment 5.3% and other. 

Orthopedic Impairment 0.4% 

Other Health Impairment 16.9% 

Severe Mental Impairment 1.2% 

Specific Learning Disability 47.9% 

Speech/Language Impairment 0.5% 

Traumatic Brain Injury 0.4% 

Student’s ideas were considered atlIEP % Student is comfortable discussing % 
meetings their needs 

Yes 80.5% Yes 80.4% 
No 2.9% No 13.3% 
Unknown 13.1% 

Future living plans % 

At home or with other family 55.8% 

In a dormitory or military base 6.9% 

In a group home/supervised shared apartment 1.5% 

Independently or with friends 31.5% 

Will request ADA support % Will request Rehabilitation Services Support % 

Yes 23.1% Yes 40.0% 
No 52.8% No 35.9% 
Need more information 17.0% Need more information 12.7% 


Notes: Report reflects information collected from 07/01/2015 to 06/30/2016. Data are self-reported by students and 
electronically submitted by student, parent, or county personnel. Percentages may not add to 100% due to missing responses. 
Low response numbers should be interpreted with caution. January 26, 2017 
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EXIT SURVEY REPORT 2015-2016 


Type of education among those planning to % 

Education plans % continue 

Plan to continue education 67.4% Adult Education (Skill Building, ABE, GED) 1.5% 
Apprenticeship/On-the-job Training 16.1% 
Career & Technical Education/Vocational training 26.7% 
College (4-year) 23.0% 
Community & Technical College (2-year) 21.5% 
Day training or supervised setting 3.7% 


Reasons among those not planning to continue their education # 


Have a job 

Need to work 

Getting married 

Unsure of plans 

Need a break from school 
Joining military 

School is too expensive 


Do not need more education for job 


Have poor grades or am not r 


eady 


168 
212 


Data presented in numbers (#) as students could select all that applied. 


A lot Some Not at all 


Levels of school staff support (%) (%) (%) 
Planning for a career 41.8% 48.8% 5.7% 
Connecting to a job 25.2% 46.6% 23.5% 
Connecting to further education/training opportunities 39.1% 46.2% 10.1% 
Connecting with adult support agencies 34.5% 43.6% 17.6% 
Developing work related skills 51.9% 38.8% 5.7% 
Having confidence to continue my education 43.4% 42.4% 9.1% 
Talking about my disability 25.1% 50.6% 18.8% 
Asking for the supports | need to be successful in work, training, and education 39.2% 49.5% 7.0% 
programs 
Helpful school supports Academic Career Tech./ Career IEP Special 
(select all that a pply. ) classes (#) Vocational activities at participation Education 
classes (#) school (#) (#) Supports (#) 
Planning for a career 804 910 556 743 805 
Connecting to a job 555 844 520 536 654 
Connecting to further 622 755 517 721 757 
education/training opportunities 
Connecting with adult support 385 465 350 950 867 
agencies 
Developing work related skills 831 880 537 582 725 
Having confidence to continue my 767 730 429 734 844 
education 
Talking about my disability 408 351 236 1065 991 
Asking for the supports | need to be 645 615 370 947 1017 


successful in work, training, and 
education programs 


Notes: Report reflects information collected from 07/01/2015 to 06/30/2016. Data are self-reported by students and 
electronically submitted by student, parent, or county personnel. Percentages may not add to 100% due to missing responses. 
Low response numbers should be interpreted with caution. Janua 
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ry 26, 2017 


ONE YEAR FOLLOW-UP SURVEY REPORT 2015-2016 


WV STATE RESULTS 


Total number of responses: 1454 


NOTE: Reports produced for each county and school 
participating in the survey. These reports were shared with 
appropriate stakeholders. 


Exit reason % Survey submitter % 
Graduated Standard Diploma 79.0% Student 1.6% 
Graduated Modified Diploma 13.6% Parent/guardian 2.4% 
Dropped out 74% County/school personnel 96.0% 
Currently (or have for at least 3 months this year) % 
Attending college (4 year) 6.8% 
Attending community & technical college (2 year) 10.0% 
Other school or training 9.8% 
In the military 1.4% 
Currently working 49.4% 
- Percent competitively employed of those working 80.4% 
Reasons among those who are not working or going to school__# _ 
Unable to work because of disability 119 
Unable to afford school or training 18 
Need to help family at home 33 
Do not know what | want to do 58 
Do not need to work/parents support me 31 
Unable to find work 104 
Unable to get accepted into a school or training program 12 
Transportation not available 32 
Other 83 
Data presented in numbers (#) as students could select all that applied. 
Receive agency support % Type of support % 
Yes 23.9% Educational 39.7% 
Work 32.5% 
Independent living 20.1% 
Other 13.5% 
% Needed % Just 
Rate the skills or training you received while in school more enough 
Everyday reading, writing and math skills 20.4% 65.3% 
Specific career/vocational skills to prepare me for my current 
job/education program 21.5% 63.6% 
Money management skills 29.4% 56.2% 
Independent and home living skills 17.4% 68.1% 
Job seeking and job keeping 25.9% 59.5% 
Specific work experiences 28.6% 56.7% 
Social skills to get along with others 11.0% 73.8% 
Technology skills for work, education, living 17.6% 67.7% 


% Too 
Tce 
1.4% 


0.8% 
1.0% 
1.0% 
0.9% 
1.0% 
1.7% 
1.0% 


Notes: Report reflects information collected from 04/01/2016 to 12/31/2016 from students exiting school during the 2014-2015 school year. 
Data are self-reported by students and electronically submitted by student, parent/guardian, county/school personnel. Percentages may not 
add to 100% due to missing responses. Low response numbers should be interpreted with caution. 
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March 16, 2017 


Resources/Documents 


f2 


afr V Ape (a WEST VIRGINIA DEPARTMENT OF EDUCATION AND THE ARTS 
KEDUCKTION if DIVISION OF REHABILITATION SERVICES 


ty 
Planning for the Future for Students 
with. Disabilities 
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A Guide For Educators In Arranging Rehabilitation Services 
For Students With Disabilities 


WEST VIRGINIA DEPARTMENT OF EDUCATION AND THE ARTS West Vi inian of 
DIVISION OF REHABILITATION SEAVICES *EDU TION 


January 2017 
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rebar Work Readiness Certificate (IWRC) Career Pathway 
The IWRC is designed to provide some students with Individualized Education Programs 
(IEPs) who are pursuing a standard high schoo! diploma the opportunity to gain work readiness 
and occupation specific skills related to CTE career programs of study during high school. 
These students demonstrate the ability to acquire basic/core CTE skills to become employed in 
a support position. 
All students working toward the IWRC enroll for the four required CTE program of study 
courses plan to enter the workforce directly after high school with on-the-job-training, 
apprenticeship or continued technical training as an adult 
Once a student is selected for the IWRC, the CTE instructor, student, parent/guardian and 
special educator will review and approve the IWRC skill sets established by the WVDE for 
student attainment of the certificate. The Personalized Education Plan (PEP) and IEP will be 
updated to reflect the IWRC program of studies. 
A copy of the approved WVDE skill sets must be provided by CTE staff and special educators 
to the student and family of IWRC candidates to assure they understand the program. 
The IEP for the student describes any specially designed instruction, supports or 
accommodations necessary for student success. 
Participating students who earn the IWRC credentials must complete the approved skill sets in 
the four core courses of a state approved CTE proaram of study. 


WV CTE Program | Program Required Specialization 
of Study: Courses: Courses: Certification(s): 
WV5502 Individual The student will follow the | The student will follow The IWRC Certificate 
Work Readiness CTE program required the CTE program will list the specific skill 
Certificate (IWRC) courses associated with | specialized courses sets the student has 
their chosen cluster associated with the mastered during the 
program of study that is cluster program of study | program. 
available at the local CTE | thatis available at the 
center, comprehensive local CTE center, 
high school or high comprehensive high 
school. The student will school or high school. 
be provided The student will follow 
accommodations and/or | the IWRC skill sets 
supports as indicated in established by the CTE 
the IEP. staff and special 
educator. The student 
will be provided 
accommodations and/or 
supports as indicated in 
the IEP. 
NOTES: 

Successful program of study completers will demonstrate their technical skills 
attainment through the CTE portfolio and state-approved technical assessment 
processes. 

EVERY student must pass ALL safety exams with a score of 100% before having 
access to available equipment with accommodations and/or supports as indicated in 
the IEP. 

CTE elective courses for all state-approved programs of study can be located in the 
Guidance Document of WVBE Policy 2520.13. 

CTE staff should be represented at students’ Individualized Education Program (IEP) 
Team meetings when the student is a prospective CTE participant. 

CTE instructors must document that they have read the most recent /EP in order to 
ensure awareness of students’ needs. 
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WEST VIRGINA TRANSITION Guide 


WORK-BASED 
LEARNING 


COUNSELING FOR 
TRANSITION & 
POST-SECONDARY 
PROGRAMS 
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CNUeak ViAGini@ department WV Alternate Summative Assessment 
XEDUC ‘TION oe Participation for Mathematics, 2015-2016 


WV Alternate Summative Assessment Participation 
Percent (%) for Mathematics, Grades 3-11 by District 


WV% = 1.40 
(Target % = 1.0) 


|] Above WV % (>1.40%) 


iS At or below WV % ($1.40%) but above 1.0% 


| At or below target ($1.0%) 
ON Bea 


Note: Results exclude WVSDB and Institutional Programs ONE FOCUS 
Source: RPTCARD16_PWVN307A 


All Students 


West (LG Department of NAVAVAPANI CelaarciccmelelanlaarclilvsWatcterossroaalevall 
“EDUC \TION oes Participation for ELA, 2015-2016 


WV Alternate Summative Assessment Participation 
Percent (%) for ELA, Grades 3-11 by District 


WV% = 1.40 
(Target % = 1.0) 


|| Above WV % (>1.40%) 


[| At or below WV % ($1.40%) but above 1.0% 


[| At or below target ($1.0%) 


Note: Results exclude WVSDB and Institutional Programs ON EFOCUS 
Source: RPTCARD16_PWVN307A . cate Mentecin 
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Graduation 20/20 Check List 


RESA 1 


2016 


RS? Reporting Log 


Jan. Feb. Mar. 


RS?: Teresa Epperley 


April 


May June 


Oct. 


\\ Co) Aum BY = om 


Mercer County 
Bluefield County High 


2016 


Signed MOU 


School Team Contact List 


School Team Agenda Minutes 


School Action Plan 


Implementation Scale 1 (Fall) 


Implementation Scale 2 (Spring) 


Monitoring Questionnaire 


Montcalm High (7-12) 


2016 


Signed MOU 


School Team Contact List 


School Team Agenda Minutes 


School Action Plan 


Implementation Scale 1 (Fall) 


Implementation Scale 2 (Spring) 


Monitoring Questionnaire 


Pikeview High 


2016 


Signed MOU 


School Team Contact List 


School Team Agenda Minutes 


School Action Plan 


Implementation Scale 1 (Fall) 


Implementation Scale 2 (Spring) 


Monitoring Questionnaire 


Princeton Senior High 


2016 


Signed MOU 


School Team Contact List 


School Team Agenda Minutes 


School Action Plan 


Implementation Scale 11 (Fall) 


Implementation Scale 2 (Spring) 


Monitoring Questionnaire 


79 


apnis 
J NO } WOYOD Jo wed Osje de S9I}UNOD jOjld IV. 
ANO 


.SONUNOD JO}! || 


saljunod | WoUuoD Be & 


80 


» Sie 
ie 
LLOC-S10C 


Ssayuno) suyndiyswd ioe 


07/07 NOILVKAGVAD AM \" BOMNR AGE, 


NVHSYV 


OIHO 


eWo|dip puepuejs ‘Woyod paysn{pe uweak-p = ayes UOI}ENpesH 


AM ee AUNOD JIOIUCH me = USI} 13 //\ 


L8°9L €T'69 Sc'OL 60°C9 T6'6S 18°68 €S°98 9v'v8 Tv'T8 ce'6L AM 

09°94 00°S9 S€69 os°49 L689 cC'T6 Ov'88 00°28 vSL8 €v'T8 Ayuno 4909UeH 

TE'6L 89'EL cs'v9 89'EL Ee EO 8v'06 £0°06 €S9°S8 c6'L8 cL'C8 USIH JBM 
GMs lIv 

9T0C STOC vIOc E107 ctOc 9T0¢ STO? vIOc €TOC clO~ ‘ 


0z 

Ov a 
ry 
a. 
= 
oo 
=A 
[oO] 
= 
a 
or 

09 ” 

08 

OOT 


9TOZ-ZTOZ Srey UO!JeENpes YSIH JAM 


sjooyps Sunedioiied 0Z/0Z NOLLVNGVUD AM Aq sayey uoenpesyd 231d NWS 


81 


Recognition of schools with graduation rate of 90% or higher 


February 10, 201 
oO je S Chamber, West \ 5 Capitol 
Charleston, WV 


Of the 70 high schools recognized with a 90% or greater graduation rate for the 2015- 
2016 school year, 51% are also participating in the WV GRADUATION 20/20 initiative. 


RESA 


DNAAAAAUNMUNUUNUNUHNUHnUHHnnN HB HBP HP HPWwWWWWWWWNNNNNN NPP RP RP RP PRP PR 


County 


McDowell 
Mercer 
Mercer 
Mercer 
Monroe 
Raleigh 
Wyoming 
Logan 
Logan 
Mason 
Mason 
Mingo 
Mingo 
Wayne 
Boone 
Clay 
Kanawha 
Kanawha 
Putnam 
Putnam 
Putnam 
Putnam 
Greenbrier 
Nicholas 
Nicholas 
Webster 
Calhoun 
Jackson 
Jackson 
Pleasants 
Ritchie 
Roane 
Tyler 
Wirt 
Wood 
Brooke 
Hancock 
Hancock 
Marshall 
Marshall 
Ohio 


School 


River View High School 

Montcalm High School 

Princeton Senior High School 
Pikeview High School 

James Monroe High School 
Liberty High 

Wyoming County East High School 
Man Senior High School 
Chapmanville Regional High School 
Wahama High School 

Hannan High School 

Tug Valley High School 


Mingo Central Comprehensive High School 


Spring Valley High School 
Sherman High School 

Clay County High School 
George Washington High School 
Sissonville High School 
Winfield High School 
Hurricane High School 
Buffalo High School 

Poca High School 
Greenbrier East High School 
Richwood High School 
Nicholas County High School 
Webster County High School 
Calhoun Middle/High School 
Ripley High School 
Ravenswood High School 

St Marys High School 

Ritchie County High School 
Roane County High 

Tyler Consolidated High School 
Wirt County High School 
Williamstown High School 
Brooke High School 

Weir High School 

Oak Glen High School 
Cameron High School 

John Marshall High School 
Wheeling Park High School 
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Grad Rate 


92.31 
93.75 
92.97 
91.18 
95.83 
91.54 
93.18 
94.74 
92.36 
97.10 
95.12 
93.59 
94.78 
90.32 
91.11 
90.77 
95.90 
90.23 
96.06 
97.79 
94.12 
92.70 
92.00 
96.10 
90.91 
93.75 
94.81 
97.91 
91.49 
95.83 
92.52 
Sil Sil 
97.09 
93.06 
92.05 
93.19 
90.48 
92.17 
97.22 
91.52 
97.83 


GRAD 20/20 
School 


SSNS 


SNE SN 


CO 00 0 00 lClUhOCUO CO 0 NIN NN NUNUGINNNNUUNON ONO DD DD ODD 


Wetzel 
Wetzel 
Wetzel 
Wetzel 
Doddridge 
Gilmer 
Harrison 
Harrison 
Marion 
Marion 
Marion 
Monongalia 
Monongalia 
Randolph 
Randolph 
Randolph 
Tucker 
Upshur 
Berkeley 
Berkeley 
Berkeley 
Grant 
Grant 
Jefferson 
Mineral 
Mineral 
Morgan 
Morgan 
Pendleton 


Paden City High School 

Valley High School 

Magnolia High School 

Hundred High School 

Doddridge County High School 
Gilmer County High School 
Bridgeport High School 

Lincoln High School 

Fairmont Senior High School 
East Fairmont High School 

North Marion High School 
Clay-Battelle High School 
University High School 

Pickens Elementary/High School 
Harman Elementary/High School 
Tygarts Valley Middle/High School 
Tucker County High School 
Buckhannon Upshur High School 
Musselman High School 

Spring Mills High School 
Martinsburg High School 
Petersburg High School 

Union Educational Complex 
Washington High School 
Frankfort High School 

Keyser High School 

Berkeley Springs High School 
Paw Paw High School 

Pendleton County Middle/High School 
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100.00 
96.36 
94.21 
91.67 
94.25 
90.14 
93.68 
95.31 
95.70 
94.57 
94.44 
98.11 
95.22 

100.00 

100.00 
95.31 
92.94 
90.58 
97.85 
91.35 
90.94 
94.50 

100.00 
92.78 
99.19 
94.63 
91.43 

100.00 
91.03 
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On-line IEP 
Page of__— 
INDIVIDUALIZED EDUCATION PROGRAM 


County Schools 
Student’s Full Name Date 


PART VI: TRANSITION PLANNING 

(For students beginning no later than the first IEP to be in effect when the student is 16, or younger if appropriate) 
(Refer to Policy 2419, 2510, and IEP instructions) 

Age of Majority 

The student and parent have been informed of the transfer of educational rights that will occur on reaching age 18 


LJ Yes 1 No Date 


Student Initials Parent/Guardian Initials 
NOTE: Age of Majority brochure is available on the WVDE website. 


Transition Planning Considerations: 
How were the student's preferences and interests considered? 


LC] Student interview/survey gO Interest inventory el Parent interview/survey Ee] Functional vocational 
evaluation 


Transition Assessments Reviewed (specify): 
The student's educational program will lead to a: [_] standard diploma [_] alternate (modified) diploma 
NOTE: Alternate (Modified) Diploma brochure is available on the WVDE website. 


Appropriate measureable postsecondary goals based upon age appropriate transition assessments: 
1. Education/Training Goals: 


2. Employment Goals: 
3. Independent living skills goal(s) (if appropriate): 


Select one of the following Career Clusters: 


Agriculture, Food and Natural Architecture and Finance 


Resources Construction 

Business Management and Education and Training Hospitality and Tourism 
Administration 

Government and Public Health Sciences Law, Public Safety, Correction and 
Administration Security 


Human Services Information Technology Science, Technology, Engineering 
and Mathematics 
Cluster Undetermined (Option for 


Grade 7 or below) 


LIOUOUO 


Manufacturing Marketing 


Ea (Es) eT Es) TET) ed 
ODOOOUOUU 


Transportation, Distribution and Arts, A/V Technology and 
Logistics Communication 


Specify the program of study that aligns with the career cluster the student selected:_ 
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Page of 
INDIVIDUALIZED EDUCATION PROGRAM 


County Schools 


Student’s Full Name Date 


Select one of the following program of studies which aligns with the student’s chosen career cluster and 
provides the best option for success in the global workplace and postsecondary education. 


[| State-Approved Career and Technical Education (CTE) Program of Study is an approved sequence of four 
CTE courses which align to a CTE cluster and pathway, impacts state economic labor market needs as verified by 
Workforce data and leads to an industry-recognized credential or certificate or opportunity for continuing into 
postsecondary level education. Students must be capable of passing 100% of the safety exams for the respective 
program of study. 


[ell State-Approved Individual Work Readiness Competencies (IWRC) - Preequisites: Before selecting 
IWRC, students must have initially selected the State-Approved (CTE) Program of Study option; completed at 
least two CTE courses in their chosen area of career interest; passed ALL safety exams; demonstrated the ability 
to acquire basic/core CTE skills at an entry level; were unable to master ALL of the required skill sets associated 
with their state-approved CTE program of study. 

IWRC is an approved sequence of four CTE courses which align to a CTE cluster and pathway that provides 
students with a current IEP the opportunity to gain valuable work readiness through a CTE program of study. 
Students demonstrate the necessary skill sets for entry level support jobs in a specific occupational area. Students 
must be pursuing a standard diploma and be capable of passing 100% of the safety exams for the respective 
program of study. 


[| State-Approved Career Integrated Experiential Learning (CIEL) a CTE program of study that provides 
opportunities for students to test for multiple nationally recognized certifications while earning credit for relevant 
job-readiness skills. CIEL can only be initiated at the Office of Diversion and Transition. CIEL credits will 
transfer to the receiving high school allowing for the continued enrollment for graduation credit. 


L] Locally Developed Career and Technical Education (CTE) Program of Study is a locally approved 
sequence of four CTE courses which align to a CTE cluster and pathway, impacts a local economic labor market 
need as verified by local advisory council and leads to an industry-recognized credential or certificate or 
opportunity for continuing into postsecondary level education. 


i Locally Developed Personalized Program of Study is a locally approved sequence of four courses which align 
to a career cluster and a program of study that could lead directly to an industry-recognized certificate or license or 
credit-bearing academic college courses. Best practice would be to encourage college bound students to take at 
least 1 (one) AP and/or AC course with corresponding examination, a fourth science or computer science credit, and 
2 credits in one world language. 


[_|Locally Developed Community Ready Program of Study is a locally approved sequence of four courses 
which align to a career cluster that will lead to placement in entry-level support jobs or workforce training 
programs. 

[_] Undetermined — Option for Grade 7 or below 


Specific course selections must be documented in the student's Personalized Education Plan (PEP) in collaboration 
with the school counselor, teachers, advisors and parent/guardian. A copy of the PEP must be kept with student’s 
IEP, 
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Page of 


Activities/Linkages: Identify activities needed for attaining postsecondary outcomes and the lead party/agency 
responsible for those services. 


Lead Party/Agency 


Parent/ Agency Annual Goal 
Activities/Linkages ident School (Specify) Description of Service to Support 


Activity 
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4 pial at 


RSs 
RESA Projects 


¢ RESA 1 —Teresa Epperly--Coach Approach 


¢ RESA 2—Marsha Walsh Jarrell--Utilization of Transition 
Planner with Rehabilitation Services 


¢ RESA 3—Patty Blake--Check & Connect 
¢ RESA 4—Rena Robinson--Student Led IEPs 


¢ RESA 5—Jackie Harris--Transition Coalition Self-Study, 
Building a Transition Assessment Toolkit 


¢ RESA 6—Michelle Hogan--Feeder Middle Schools 
¢ RESA 7—Lisa Heinbaugh--One Year Out/Follow-Up ONEVOCe 
¢ RESA 8—Andrew Guthrie--Family Involvement ON FFOCS 


Ali Students Ac 


4 West Virginia 


EDUCATION 


Indicator 2: Dropout Rate 


Grades 7-12 Event Drop Rate 
-@SWDs -#Targets 


3.10% 


2.759 : 2.75% 


2.75% 
2.45% 2.45% 


2.25% 2.25% 


2.20% 2.20% 


2.00% 


1.73% 
1.22% = 4.16% 


2009-2010 2010-2011 2011-2012 2012-2013 2013-2014 2014-2015 2015-2016 2016-2017 2017-2018 


ONEVOICE 
ONEFOCUS 


All Students Ac 
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4-Year Adjusted Cohort Graduation Rates by RESA: 2012 - 2016 


Scale => 
All SWD 
RESA 2012 2013 2014 2015 2016 2012 2013 2014 2015 2016 


NOTE: The color scale on each row of the table above represents only 1 county and 1 subgroup (All or SWD) 
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Graduation rate = 4-year adjusted cohort, standard diploma. 
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MARSHALL GRAD RATES 2012-2016 
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WETZEL GRAD RATES 2012-201 
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GRADUATION 20/20 
2016-2017 GRADUATION 20/20 RS? and SCHOOL ASSIGNMENTS 
COHORT 1 


RESA 1 
GRADUATION 20/20 RS? - Teresa Epperley - tepperle@k12.wv.us 


Participating School 


Bluefield High 

naereer Montcalm Bled (7-12) 
Pikeview High 
Princeton Senior High 


[Monroe ares Monroe High 


Mount View High 
McDowell River View High 

Southside K-8* 

Independence High 
Raleigh Liberty Hien 

Shady Spring High 

Woodrow Wilson High 


Summers County High 
Weenie WCE: Hien 
Wyoming High 
RESA 2 
GRADUATION 20/20 RS? - Marsha Jarrell - mdwalsh@k12.wv.us 


County Participating Schools 
Cabell cat alli High 
Hungington High 
Logan Logan Dati! High 
Man Senior High 
Point Pleasant Junior*/Senior High 
Mingo Mingo cone) High 
Tug Valley High 
Wayne Spring valle) High 
Wayne High 


RESA 3 
GRADUATION 20/20 RS? - Patty Blake - prblake@k12.wv.us 


Van Junior*/Senior High 
Capital High 

Herbert Hoover High 
Nitro High 

Riverside High 

Saint Albans High 
Sissonville High 

South Charleston High 


Putnam Poca High 


RESA 4 
GRADUATION 20/20 RS? - Rena Robinson - ryrobins@k12.wv.us 


PaTnlasting Senool 


Ansted Middle* 
Fayetteville High 
Meadow Bridge High 
Midland Trail High 
Oak Hill High 

Valley High 


GRADUATION 20/20 
2016-2017 GRADUATION 20/20 RS? and SCHOOL ASSIGNMENTS 
COHORT 1 


RESA 5 
GRADUATION 20/20 RS? - Jackie Harris - jsharris@k12.wv.us 
Calhoun Middle*/High 
Geary Elementary/Middle* 
Roane County High 
Spencer Middle* 
Walton Elementary/Middle* 


RESA 6 

GRADUATION 20/20 RS? - Michelle Hogan - michelle.hogan@k12.wv.us 
Brooke County High 
Follansbee Middle* 
Wellsburg Middle* 
Oak Glen High 
Oak Glen Middle* 
Weir High 
Weir Middle* 
Weir Alternative Middle* 
Gateway Achievement Center 
John Marshall High 
Moundsville Middle* 
Bridge Street Middle* 
Triadelphia Middle* 
Warwood Middle* 
Wheeling Middle* 
Wheeling Park High 


New Martinsville Elementary* 
Wetzel 2 ‘ 
Paden City High 


RESA 7 
GRADUATION 20/20 RS? - Lisa Heinbaugh - Iheinbaugh@k12.wv.us 


Liberty High 
Harrison Lincoln High 

Robert C. Byrd High 

South Harrison High 


Lewis County High 


East Fairmont High 
Marion Fairmont Senior High 
North Marion High 
ur 


r 
d E 
Tucker Tucker County High 
Buckhannon Upshur High 


RESA 8 
GRADUATION 20/20 RS? - Andrew Guthrie - aguthrie@k12.wv.us 


Participating Schools 
Berkeley Martinsburg High 


Capon Bridge Middle* 
Hampshire Hampshire Senior High 

Romney Middle* 

Moorefield High 


*Pjlot Middle Schools 
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